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TITLE OF THE INVENTION 



DIAGNOSTIC SUPPORT APPARATUS 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This is a Continuation Application of PCT 
Application No. PCT/ JP02/10943, filed October 22, 2002, 
which was not published under PCT Article 21(2) in 
English. 

This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 2001-324036, filed October 22, 2001, 
the entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to a diagnostic 
support apparatus. 

2*. Description of the Related Art 

In the medical field, there is increasing practice 
of making diagnoses using imaging equipment such as 
X-ray apparatuses, CT apparatuses, MR I apparatuses, 
ultrasound observation apparatuses, and endoscopic 
apparatuses . 

For example, with an endoscopic apparatus, a 
doctor can observe the organs in the body cavity and 
make a diagnosis by inserting the elongated insertion 
portion into the body cavity and using a solid-stage 
imaging element or the like as an imaging means. In 
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addition, an ultrasound endoscopic apparatus is also 
widely used, which irradiates the organs in the body 
cavity with ultrasound waves and allows a doctor to 
observe the state of the organs in the body cavity 
on the monitor screen by means of reflection, 
transmittance, or the like of the ultrasound waves, 
thereby allowing the doctor to make an examination or 
diagnosis . 

Furthermore, image filing systems and the like 
have been popularized, which can save images sensed by 
these apparatuses upon adding various information to 
the images and allow them to be retrieved, acquired, 
and displayed as needed. 

However, final diagnoses using these medical 
imaging apparatuses are mainly based on the subjective 
points of view of doctors. Demands have therefore 
arisen for the realization of a diagnostic support 
apparatus which directly leads to objective, numerical 
diagnoses. A diagnostic support apparatus is designed 
to find a lesion from an image to be diagnosed by 
performing threshold processing or using a statistical/ 
non-statistical discriminator on the basis of various 
characteristic values calculated from the image or a 
region of interest set on the image, and to present a 
doctor classification to specific findings and lesions, 
thereby supporting an objective, numerical diagnosis. 

In contrast to this, in the field of breast cancer 
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diagnosis (mammography) using X-ray images, a 
diagnostic support apparatus for recognizing an 
abnormal finding such as calcification and assisting a 
doctor's diagnosis has been put into practice. A 
5 diagnostic support apparatus which assists differentia- 

tion of lesions is also disclosed in, for example, 
Jpn. Pat. Appln. KOKAI Publication No. 10-148 64. This 
apparatus is designed to realize diagnostic support for 
differentiation of various diseases on the basis of 

10 many patients, examinations, and image information 

recorded in an image filing system or the like. 

The conventional diagnostic support apparatuses 
have, however, the following problems. 
(1) Problem Concerning Diagnostic Support Contents 

15 Diagnostic support contents that can be used in 

clinical examination are fixed in each diagnostic 
support apparatus to be used, including, for example, 
"finding of breast cancer shadow" and "examination on 
pneumoconiosis" (in the present invention, various 

20 diagnostic support types and contents are generally 

referred to as diagnostic support contents hereinafter; 
a detailed description thereof will be made later) . In 
spite of the fact that a diagnostic support apparatus 
basically uses a general-purpose computer or 

25 workstation as hardware, the user cannot easily obtain 

desired diagnostic support information in accordance 
with diagnosis purposes and contents or make additions, 
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improvements, and the like with respect to diagnostic 
support contents. 

(2) Problem Concerning Development of Diagnosis 
Support Contents 

In general, diagnostic support contents are 
developed on the basis of element techniques provided 
from mathematical engineering organizations and 
companies and data and medical knowledge provided from 
a limited number of specific university hospitals and 
various kinds of medical facilities. These element 
techniques are highly specialized into image analysis 
techniques and identification/classification 
techniques . 

Image filing systems have currently been used in 
many medical facilities and organizations, and much 
data is stored in the systems. The respective medial 
facilities differ in the numbers of specialties and 
cases for each disease. In spite of the fact that 
various diagnostic support contents can be developed 
by integrating this data and most advanced medical 
knowledge, no versatile tool is available or cannot be 
obtained. This hinders improvement in this field. 
Although various medical facilities and doctors have 
made many studies that can be implementation elements 
for diagnostic support, the results cannot be 
clinically used under present circumstances because of 
this problem. 
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(3) Problem Concerning Improvements to Diagnostic 
Support Contents 

The diagnostic support contents in a diagnostic 
support apparatus have already been established, and 
5 the user cannot improve the contents by, for example, 

adding case data. For example, more useful diagnostic 
support can be realized by implementing basic 
diagnostic support contents and improving the contents 
by, for example, adding data while clinically using 
10 them in many medical facilities, or by adding new 

information. However, as in the case of problem (2) 
described above, there is no means, such as a tool, 
which is necessary to improve the diagnostic support 
contents . 

15 BRIEF SUMMARY OF THE INVENTION 

It is an object of the present invention to 
provide a diagnostic support apparatus which allows 
various information, image data, and expert medical 
knowledge accumulated in many medical facilities to be 

20 widely used on diagnostic support apparatuses, can 

improve the performance of the diagnostic support 
apparatus, and allows selective use of diagnostic 
support in accordance with purposes and contents. 

It is another object of the present invention to 

25 provide a diagnostic support apparatus which can easily 

and effectively assist various processes and operations 
required to create diagnostic support contents. 
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A diagnostic support apparatus according to the 
first aspect of the present invention comprises: 

diagnostic support content storage means for 
storing a plurality of diagnostic support contents for 
5 providing diagnostic supports- 

selection means for selecting a desired diagnostic 
support content from the plurality of diagnostic 
support contents stored in the diagnostic support 
content storage means; 
10 information acquisition means for acquiring 

diagnostic information concerning at least one of a 
patient, an examination, and an image from a medical 
system; 

diagnostic support information creating means for 
15 creating diagnostic support information on the basis 

of the diagnostic support content selected by the 
selection means and the diagnostic information acquired 
from the medical system; and 

diagnostic support information display means for 
20 displaying the diagnostic support information created 

by the diagnostic support information creating means. 

A diagnostic support method of providing 
diagnostic support using a computer according to the 
second aspect of the present invention comprises: 
25 a step of acquiring a diagnostic support content; 

a step of inputting diagnostic information 
concerning at least one of a patient as a diagnostic 
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support target, an examination, and an image; 

a step of creating diagnostic support information 
using the diagnostic support content and the diagnostic 
information; and 
5 a step of displaying the diagnostic support 

information. 

An information processing apparatus according to 
the third aspect of the present invention comprises: 

storage means for storing processing data 
10 constituted by at least one image data, character 

string data, and numerical value data; 

graph creating means for creating graph 
information from the numerical value data; 

image list information creating means for creating 
15 image list information from the image data; 

table list information creating means for creating 
table list information from the character string data 
and the numerical value data; 

display means for displaying the graph infor- 
20 mation, the image list information, and the table list 

information; 

selection means for selecting information 
displayed on the display means; and 

information management means for managing the 
25 graph information, the image list information, and the 

table list information displayed on the display means. 

A diagnostic support apparatus for supporting a 
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diagnosis by an examiner according to the fourth aspect 
of the present invention comprises 

image storage means for storing image data input 
from an endoscopic device, characteristic value 
5 calculation means for calculating at least one 

characteristic value to quantify a finding associated 
with a diagnosis from image data stored in the image 
storage means, and diagnostic support information 
display means for displaying diagnostic support 
10 information on the basis of a calculation result 

obtained by the characteristic value calculation means, 

the characteristic value calculation means 
including 

blood vessel extraction means for extracting a 
15 transmission blood vessel image in the image data 

stored in the image storage means; and 

blood vessel characteristic value calculation 
means for representing a running state of a see-through 
blood vessel image as a characteristic value on the 
20 basis of an output from the blood vessel extraction 

means . 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
FIG. 1 is a view showing a form of a diagnostic 
support system according to the first embodiment of the 
25 present invention; 

FIG. 2 is a view for explaining the arrangement 
of a diagnostic support content server #2 in this 



embodiment; 

FIG. 3 is a view for explaining the arrangement of 
a diagnostic support execution terminal #3 in this 
embodiment; 

FIG. 4 is a block diagram of a main program #31 
executed by a control means #9 of the diagnostic 
support content server #2 in this embodiment; 

FIG. 5 is a block diagram showing a diagnostic 
support content distribution executing section #32 in 
more detail; 

FIG. 6 is a flowchart for explaining a series of 
operations in distribution of diagnostic support 
contents in this embodiment; 

FIG. 7 is a block diagram of a main program #51 
executed by a control means #12 of the diagnostic 
support execution terminal #3 in this embodiment; 

FIG. 8 is a flowchart for explaining a series of 
operations accompanying the reception of a diagnostic 
support content by the diagnostic support execution 
terminal #3 in this embodiment; 

FIG. 9 is a view showing the first example of a 
diagnostic support content; 

FIG. 10 is a view showing the second example of a 
diagnostic support content; 

FIG. 11 is a view showing the third example of a 
diagnostic support content; 

FIG. 12 is a view showing detailed display of the 
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third example of a diagnostic support content; 

FIG. 13 is a view showing the fourth example of a 
diagnostic support content; 

FIG. 14 is a view showing the fifth example of a 
5 diagnostic support content; 

FIG. 15 is a view showing the arrangement of a 
diagnostic support content object A60; 

FIG. 16 is a flowchart for explaining a series of 
operations accompanying the creation of diagnostic 
10 support information and updating/addition of a 

diagnostic support content by the diagnostic support 
execution terminal #3 in this embodiment; 

FIG. 17 is a view showing a diagnostic support 
content list menu; 
15 FIG. 18 is a view showing a form of a diagnostic 

support system according to the second embodiment of 
the present invention; 

FIG. 19 is a view for explaining the arrangement 
of a diagnostic support content creating terminal #102 
20 in this embodiment; 

FIG. 20 is a block diagram of a main program #121 
executed by a control means #12 of the diagnostic 
support content creating terminal #102 in this 
embodiment; 

25 FIG. 21 is a flowchart for explaining a series of 

operations in diagnostic support content creation; 

FIG. 22 is a view showing a window group for data 
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set creation; 

FIG. 23 is a view showing an examination condition 
setting window A120; 

FIG. 24 is a view showing a text information 
5 setting window A125; 

FIG. 25 is a view showing a reference image 
setting window A130; 

FIG. 26 is a view showing a call diagnostic 
support content selection window A14 0; 
10 FIG. 27 is a view showing a diagnostic support 

main menu window A200; 

FIG. 28 is a view showing an examination condition 
setting window A210; 

FIG. 29 is a view showing a diagnostic support 
15 content setting window A220; 

FIG. 30 is a view showing a terminal authentica- 
tion information setting window A230; 

FIG. 31 is a flowchart for explaining a series of 
operations accompanying the creation of diagnostic 
20 support information and updating/addition of a 

diagnostic support content by a diagnostic support 
execution terminal #3 in this embodiment; 

FIG. 32 is a view showing a display example of a 
diagnostic support execution window; 
25 FIG. 33 is a view showing a diagnostic support 

content server selection window A260; 

FIG. 34 is a view showing a diagnostic support 
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content creating main window A27 0; 

FIG. 35 is a view showing a diagnostic support 
content list menu; 

FIG. 36 is a view showing a diagnostic support 
5 execution terminal main program; 

FIG. 37 is a flowchart for explaining operation 
associated with updating/addition of a diagnostic 
support content by the diagnostic support execution 
terminal #3 in this embodiment; 
10 FIG. 38 is a view showing an example of the 

contents of an update/add inquiry information file; 

FIG. 39 is a block diagram of a main program #121, 
which shows the arrangement of a diagnostic support 
content creating section #127 according to the third 
15 embodiment of the present invention; 

FIG. 40A is a view showing an image information 
format; 

FIG. 4 OB is a view showing item management 
information contents; 
20 FIG. 40C is a view showing auxiliary information 

contents; 

FIG. 41 is a view showing an item selection 
window; 

FIG. 42 is a flowchart (part 1) for explaining a 
25 series of operations accompanying graph information 

creation in this embodiment; 

FIG. 43 is a flowchart (part 2) for explaining a 
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series of operations accompanying graph information 
creation in this embodiment; 

FIG. 44 is a flowchart (part 3) for explaining a 
series of operations accompanying graph information 
5 creation in this embodiment; 

FIG. 45 is a flowchart (part 4) for explaining a 
series of operations accompanying graph information 
creation in this embodiment; 

FIG. 46 is a flowchart (part 5) for explaining a 
10 series of operations accompanying graph information 

creation in this embodiment; 

FIG. 47 is a view showing a display example of a 
graph in this embodiment and more specif ically, an 
example of a one-dimensional scatter diagram; 
15 FIG. 48 is a view showing a display example of a 

graph in this embodiment, and more specifically, an 
example of a histogram; 

FIG. 49 is a view showing a display example of a 
graph in this embodiment, and more specifically, an 
20 example of superimposing t test results on an average 

value bar graph; 

FIG. 50 is a view showing a display example of a 
graph in this embodiment, and more specifically, an 
example of superimposing % 2 test results on a case 
25 count bar graph; 

FIG. 51 is a view showing display of statistics or 
statistical test results associated with accompanying 
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data items; 

FIG. 52 is a view showing display of an operation 
window having a check box 165; 

FIG. 53 is a flowchart showing a modification of 
5 the processing flow in FIG . 44; 

FIGS. 54A and 54B are views showing the contents 
displayed when the check box 165 is checked in 
operation for the graph information display in FIG. 47; 

FIGS. 55A to 55C are views each displaying graphs 
10 equal in number to the number of times a statistical 

test is performed; 

FIG. 56 is a block diagram of a main program #121, 
which shows the arrangement of a diagnostic support 
content creating section #127 according to the fourth 
15 embodiment of the present invention; 

FIG. 57 is a flowchart for a display information 
management section 172, which explains linking 
operation between an image information list 173 and 
graph information 160 in this embodiment; 
20 FIG. 58 is a view showing display of a list of 

image information acquired from a storage means 
management section #123 as an image information 
list 173; 

FIG. 59 is a view showing graph information 160; 
25 FIG. 60 is a view showing operation of enclosing 

graph elements with a rectangle on the graph informa- 
tion 160; 
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FIG. 61 is a flowchart for the display information 
management section 172 and an information setting 
section 181, which explains display changing operation 
for the image information list 173 and graph infor- 
5 mation 160, accompanying a change of the settings of 

image information; 

FIG . 62 is a block diagram of a block diagram of 
the main program #121, which shows the arrangement of 
the diagnostic support content creating section #127 
10 according to the fourth embodiment of the present 

invention; 

FIG. 63 is a view showing a menu 190 including 

selected element information updating 191 and selected 

element region-of-interest setting 192; 
15 FIG. 64 is a view showing a setting operation 

window for the accompanying data of image information, 

which is used by an item value setting section 183; 

FIG. 65 is a view showing the arrangement of an 

information update window 184; 
20 FIG. 66 is a view showing how the item values of 

corresponding items are stored in a menu 230 and 

displayed; 

FIG. 67 is a view for explaining a modification of 
the fifth embodiment; 
25 FIG. 68 is a view showing a display example of 

item names set by the item value setting section 183; 

FIG. 69 is a block diagram of a main program #121, 
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which shows the arrangement of a diagnostic support 
content creating section #127 according to the fifth 
embodiment of the present invention; 

FIG. 70 is a flowchart for a region-of-interest 
5 setting section 201, which explains setting of a region 

of interest in this embodiment; 

FIG. 71 is a view showing display of an image 
information list 173 in this embodiment; 

FIG. 72A is a view showing the operation of a 
10 mouse 23 in a moving step (TI-2) and display on an 

image; 

FIG. 72B is a view showing the operation of the 
mouse 23 in a size changing step (TI-4) and display on 
an image; 

15 FIG. 72C is a view showing the operation of the 

mouse 23 in a position temporarily determining step 
(TI-3) and display on an image; 

FIG. 73 is a block diagram of a main program #121 
according to the seventh embodiment of the present 
20 invention; 

FIG. 74 is a flowchart for a marker rendering 
section 213, which explains marker rendering on image 
data in accordance with an item contained in accom- 
panying data in this embodiment; 
25 FIGS. 75A, 7 5B, and 75C are views for explaining 

rendering operation in the marker rendering section; 

FIG. 76 is a block diagram of a main program #121 



according to the eighth embodiment of the present 
invention; 

FIG. 77 is a flowchart for a character information 
erasing section 240 and character information rendering 
section 241, which explains how patient examination 
information is erased from image data and item 
information contained in accompanying data is rendered 
on the image data; 

FIG. 78 is a view showing a display example of 
image data obtained by erasing the patient examination 
information rendered on the image data and rendering 
the values of characteristic values 1 and 2; 

FIG. 79 is a block diagram of a main program #51 
according to the ninth embodiment of the present 
invention; 

FIG. 8 0 is a block diagram showing an image 
processing section 220 in detail; 

FIG. 81 is a view showing an image processing 
table 251; 

FIG. 82 is a flowchart for an image processing 
section 250, which explains calculation of an image 
processing value corresponding to the pixel value of 
image data; 

FIG. 83 is a block diagram of a main program #51 
according to the 10th embodiment of the present 
invention; 

FIG. 84A is a flowchart for a data embedding 
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section 260, which explains embedding of accompanying 
data and region-of-interest data in image data in this 
embodiment; 

FIG. 84B is a flowchart for a data embedding 
5 section 230, which explains acquisition of accompanying 

and region-of-interest data embedded in image data in 
this embodiment; 

FIG. 85 is a view for explaining the operation in 
FIG. 84A; 

10 FIG. 86 is a view for explaining the operation in 

FIG. 84A; 

FIG. 87 is a view showing the arrangement of a 
main program #121 having a characteristic value 
calculation means 008 according to the 11th embodiment; 
15 FIG. 8 8 is a view showing the arrangement of the 

characteristic value calculation means 008 in the 11th 
embodiment ; 

FIG. 8 9 is a view showing the arrangement of a 
blood vessel extraction means 101 in the characteristic 
20 value calculation means 008; 

FIG. 90 is a flowchart for mainly explaining 
processing in the blood vessel extraction means 101; 

FIG. 91 is a block diagram of a preprocessing 
section 111; 

25 FIG. 92 is a schematic flowchart showing 

processing performed by a blood vessel candidate 
extracting section 121 for extracting blood vessel 
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candidates on the basis of outputs from an edge 
information detecting section 122 and color tone 
calculating section 123; 

FIG. 93 is a view showing an example of a spatial 
5 filter for performing second-order differentiation 

processing in the edge information detecting 
section 122; 

FIG. 94 is a schematic flowchart showing 
processing performed by a shape edge determining 
10 section 132 on the basis of an output from a density 

gradient information calculating section 131; 

FIG. 95 is a schematic flowchart showing the 
processing of separating and removing a form edge from 
a blood vessel candidates on the basis of the results 
15 obtained by the blood vessel candidate extracting 

section 121 and shape edge determining section 132; 

FIG. 96 is a conceptual view of a density 
distribution/ density gradient, second-order 
differentiation, color tone data, and blood vessel 
20 candidate data (to be described later) on a horizontal 

line of an image on which a blood vessel and shape edge 
exist; 

FIG. 97 is a conceptual view of the density 
distribution, density gradient, and shape edge data 
25 based on shape edge determination (to be described 

later) at a blood vessel and shape edge; and 

FIG. 98 is a conceptual view of the logical 
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Product of the blood vessel candidate data and shape 
edge data at a blood vessel and shape edge. 

DETAILED DESCRIPTION OF THE INVENTION 
[First Embodiment] 

The details of diagnostic support in the present 
invention will be described first. 

in general, a doctor performs diagnostic operation 
based on his/her own Judgment. This means that the 
diagnosis results may vary depending on the differences 
between the experiences and differences in subjective 
judgment of doctors. With regard to this problem 
diagnostic support is aimed at realizing accurate 
diagnoses without variations by providing various 
information, e.g., objective representation of 
information concerning findings, display of 
disease classification results obtained by an 
identification/classification technique, such as a 
linear discrimination function or neural network, and 
display of typical and similar cases as references at 
the time of diagnosis. Diagnostic support contents are 
the contents and types of support information to be 
provided for diagnostic support. For example, 
variations ® to © are conceivable as diagnostic 
support contents. Such a diagnostic support content is 
created as needed in accordance with imaging equipment 
(modality; the present invention will exemplify an 
endoscopic system,, examination regions, the names of 
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patients of interest, and the like. 

® Objective Representation of Image Findings and 

Statistical Information Display Pertaining to 

Disease 

5 In the medical endoscope field, for example, a 

color tone is one of important image findings. As a 
numerical value (characteristic value) objectively 
representing a difference in color tone, the IHb value 
is widely used. The IHb value is a value obtained for 
10 each pixel of an endoscopic image formed from an RGB 

color signal according to 
321og2Ri/Gi 

This value is known as a value which has correlation 
with a submucous blood flow. As the mucous membrane 

15 becomes redder, the IHb value increases. In this case, 

"i" is a suffix representing a pixel number, and an 
average value in an overall image or a region of 
interest is used as diagnostic support information. 
FIG. 9 shows an example of the diagnostic support 

20 content for providing diagnostic support for gastritis 

by using the IHb value. FIG. 9 shows the contents of a 
display window presented to a doctor. A display area 
Al is constituted by a diagnostic support content name 
A2, graph information area A3, diagnostic information 

25 area A4, and statistical information area A5. In the 

graph information area A3, the occurrence probability 
distributions of IHb values in a normal group and 
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disease group (gastritis group in this case) are 
graphically represented, and a pointer A6 indicating 
the position of the IHb value obtained from a case as a 
diagnosis target is superimposed on this representa- 
5 tion. In the diagnostic information area A4, 

occurrence probability information obtained by 
referring to the IHb value of the case as the diagnosis 
target and the normal and gastritis groups in the graph 
information area A3 is displayed, and text information 

10 such as "there is a suspicion of gastritis due to 

Helicobacter pylori infection" is also output. The 
following statistical information is displayed in the 
statistical information area A5: average values ± 
standard deviations of IHb values in the normal and 

15 gastritis groups, a boundary value at which the 

occurrence probabilities in the respective groups 
coincide with each other, the sensitivity of the 
diagnostic support information using the IHb values, a 
specificity, and the like. The doctor executes a final 

20 diagnosis by referring to these pieces of diagnostic 

support information. Therefore, a diagnosis which has 
been dependent on a subjective judgment such as "the 
surface of the mucous membrane is red" is made on the 
basis of objective, statistical grounds by referring to 

25 the diagnostic support content described in this 

embodiment . 

Alternatively, a pseudo-color image may be 
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generated on the basis of the IHb values to be 
displayed together with the endoscopic image. 

Diagnostic support using such characteristic 
values and statistical information is not limited to 
5 the color tone of an endoscopic image, and a diagnostic 

support content can be created, as needed, in accor- 
dance with another modality such as an X-ray image or 
ultrasound image and various types of findings such as 
structural components and density information. In 
10 addition, a similar diagnostic support content can be 

created with respect to the red blood cell count 
obtained by a blood examination, numerical values other 
than characteristic values which are obtained from an 
image, and the like. 
15 © Disease Type Display Based on 

Identification/Classification Result Using Feature 
Amounts Obtained by Application of Image Analysis 
Technique 

FIG. 10 shows an example of a diagnostic support 
20 content for providing diagnostic support for a 

protruded lesion of stomach (adenocarcinoma or early 
cancer) using a plurality of types of characteristic 
values obtained from an endoscopic image and an 
identification/classification technique. FIG. 10 shows 
25 the contents of a display window presented to the 

doctor. A display area All is constituted by a 
diagnostic support content name A12, calculated 
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characteristic value information area A13, and 
diagnostic information area A14. The information 
displayed in the calculated characteristic value 
information area A13, which is associated with the 
5 values of characteristic values (three types in this 

case, i.e., the IHb value, G variation coefficient, and 
blood vessel area ratio) used for diagnostic support, 
includes the values calculated from a diagnosis target 
and average values as diagnosis results in a normal 

10 group, adenocarcinoma group, and early cancer group. 

In the diagnostic information area A14, an 
identif ication/classif ication technique name (linear 
discrimination function in this case) , a class name as 
an identification result, and an identification/ 

15 classification result are displayed. 

In addition, text information such as "a biopsy is 
required" for a more accurate diagnosis is displayed 
(biopsy is a diagnostic method of sampling a mucous 
tissue using a special needle and checking a tissue 

20 image under a microscope) . 

(D Display of Images of Typical Case and Similar Case 
and Patient Examination Information 
FIG. 11 shows an example of a diagnostic support 
content for providing diagnostic support by displaying 

25 images of typical and similar cases of suspected 

diagnosis result for comparison with an image of a case 
as a diagnosis target. FIG. 11 shows the contents of 
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a display window presented to the doctor. This window 
is formed as a window that allows the doctor to 
interactively give instructions using an input means 
such as a mouse. As the contents shown in FIG. 11, 
5 the following are displayed in a display area A21: a 

diagnostic support content name A22, a diagnosis target 
image display area A23, a reference image display area 
A24, a button A25 for selecting the typical case or 
similar case as a reference image, selection buttons 

10 A26 for selecting and displaying consecutive images of 

a plurality of reference images, a details display 
button A27 for displaying the details of a reference 
image, a diagnosis name display/pull-down menu A28 for 
reference images, a comparative information display 

15 area A29 for various characteristic values of a 

diagnosis target image and reference image, and a 
cursor A30 for selecting each button and menu by mouse 
operation and clicking. 

An image selected as a reference image is an image 

20 of a case based on the diagnosis results obtained from 

the above diagnostic support contents ® and (D or the 
diagnosis name manually designated by the doctor using 
the menu A28. In this case, the reference image 
assigned No. 12 corresponding to Ila type early stomach 

25 cancer is displayed. When the details display button 

A27 is clicked, the detailed display window of the 
reference image in FIG. 12 opens as another window to 



display various information. When a similar case image 
is selected as a reference image, a case image similar 
to the values of the respective characteristic values 
displayed in the comparative information display area 
A29 is retrieved and displayed. 

In this manner, a typical case image or similar 
case image of a suspected disease is displayed to 
allow the doctor to compare and examine in making a 
diagnosis. This makes it possible to compensate for 
the differences in experience and knowledge between 
doctors and improve the accuracy of a diagnosis. 
© Display of Information such as Findings of Interest 
with respect to Suspected Disease 
FIG. 13 shows an example of a diagnostic support 
content for providing diagnostic support in diagnosing 
a suspected disease with respect to a case as a 
diagnosis target by displaying findings of interest 
and information of differences from a disease as a 
differentiation target. FIG. 13 shows the contents of 
a display window presented to the doctor. This window 
is formed as a window that allows the doctor to 
interactively give instructions using an input means 
such as a mouse. As the contents shown in FIG. 13, 
the following are displayed in a display area A41: a 
diagnostic support content name A42, a diagnosis target 
disease name display/pull-down menu A43, a diagnosis 
target disease information display area A44, a 
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differentiation target disease information area A45, a 
display information change button A4 6 for displaying 
another differentiation target disease information, and 
a cursor A47 for selecting each button and menu by 
mouse operation and clicking. 

The information displayed in the diagnosis target 
disease information display area A44 is information 
concerning image findings which are important for a 
diagnosis with respect to the diagnosis results 
obtained by the above diagnostic support contents (D 
and (2) and the diagnosis name manually designated by 
the doctor using the menu A43. In addition, similar 
information concerning another disease whose 
differentiation is important is displayed in the 
differentiation target disease information area A45. 
Differentiation target diseases are set for each 
diagnosis name. For Ila type early stomach cancer in 
this case, protruded lesions such as adenocarcinoma, 
hyperplastic polyp, and lymphoma are set as differ- 
entiation targets. Such pieces of finding information 
of interest are sequentially displayed by clicking the 
display information change button A4 6. By always 
presenting contents based on latest medical information 
as such pieces of information, the doctor can make a 
diagnosis with reference to these pieces of information 
as well as on the basis of his own memory and 
experience . 



(D Display of Information such as Examination Items 
and Treatment Contents for Disease 
FIG . 14 shows an example of the diagnostic support 
content for providing diagnostic support for a case as 
a diagnosis target in a diagnosis of a suspected 
disease by displaying information concerning selection 
of an examination item to be executed and a suitable 
treatment. FIG. 14 shows the contents of a display 
window presented to the doctor. This window is formed 
as a window that allows the doctor to interactively 
give instructions using an input means such as a mouse. 
As the contents shown in FIG. 14, the following are 
displayed in a display area A51 : a diagnostic support 
content name A52, a diagnosis target disease name 
display/pull-down menu A53, an examination content 
display area A54 for a diagnosis target disease, a 
treatment content display area A55 for the diagnosis 
target disease, and a cursor A56 for selecting a menu 
by mouse operation and clicking. 

The information displayed in the examination 
content display area A54 is information concerning an 
examination item which is important for a diagnosis 
with respect to the diagnosis results obtained by the 
above diagnostic support contents (D and (D and the 
diagnosis name manually designated by the doctor using 
the menu A53. Information concerning treatment 
contents after diagnosis confirmation is displayed in 
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the treatment content display area A55. By introducing 
latest findings as these pieces of information in 
accordance with medical advances, diagnostic support 
can be provided, which effectively assists the doctor's 
5 memory and experience. 

The characteristic values and the like used for 
the above diagnostic support content can be changed, as 
needed, in accordance with modality and diagnosis 
purposes. The respective diagnostic support contents 

10 can be simultaneously executed. By simultaneously 

using a plurality of diagnostic support contents in, 
for example, a multi-window form or by combinational 
display, more information can be presented. 

The first embodiment of the present invention will 

15 be described next with reference to the several views 

of the accompanying rendering. This embodiment relates 
to a diagnostic support apparatus which can selectively 
obtain diagnostic support information in accordance 
with examination purposes and types and allows the use 

20 of latest diagnostic support contents. 

FIG. 1 shows a form of the diagnostic support 
system according to the first embodiment of the present 
invention. Referring to FIG. 1, reference numeral #1 
denotes a diagnostic support system according to the 

25 first embodiment of the present invention; #2, a 

diagnostic support content server which distributes 
diagnostic support contents through a network #4 formed 
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from a WAN (Wide Area Network) or LAN (Local Area 
Network) ; and #3, a diagnostic support execution 
terminal which is installed in a hospital, clinic, or 
the like to execute diagnostic support by using the 
5 diagnostic support contents distributed from the 

diagnostic support content server #2 and the diagnostic 
information obtained by a medical system #5. 

In this embodiment, the diagnostic support content 
server #2 and diagnostic support execution terminal #3 

10 are computers, each having a display means such as a 

CRT or LCD and input means such as a keyboard and 
mouse. For the sake of convenience, FIG. 1 shows an 
arrangement in which one each of the diagnostic support 
content server and diagnostic support execution 

15 terminal is connected to the network, but pluralities 

of such servers and contents may exist on the same 
network. 

In the diagnostic support system, in order to 
ensure security, the diagnostic support content server 

20 #2 and diagnostic support execution terminal #3 can 

establish communication by transmitting and receiving 
authentication information such as the server name, 
facility name, IDs, and passwords. 

FIG. 2 is a view for explaining the arrangement of 

25 the diagnostic support content server #2 in this 

embodiment. The diagnostic support content server #2 
is constituted by a diagnostic support content storage 



means #6 which stores diagnostic support contents and 
diagnostic support content management information, a 
control means #9 which controls the operation of the 
diagnostic support content server #2, a main program 
storage means #7 which stores the main program to be 
executed by the control means #9, a distribution 
destination management file storage means #8 which 
specifies and authenticates the distribution 
destination of a diagnostic support content, and an 
input/output control means #10 which controls 
input/output operation through the network #4 in 
distribution of diagnostic support contents. The 
diagnostic support content storage means #6, main 
program storage means #7, and distribution destination 
management file storage means #8 use a hard disk 
connected to the computer that realizes the diagnostic 
support content server #2. The control means #9 is 
operated by executing the main program using the CPU 
and main memory. 

FIG. 4 is a block diagram of a main program #31 
executed by the control means #9 of the diagnostic 
support content server #2 according to this embodiment. 
This program is constituted by a diagnostic support 
content distribution executing section #32 which 
executes a series of operations in distribution of 
diagnostic support contents, and a storage means 
management section #33 which controls a series of 
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access operations accompanying retrievals, reads, and 
the like from the diagnostic support content storage 
means #6 and distribution destination management file 
storage means #8. 
5 As described above, diagnostic support contents 

provide various diagnostic support for the diagnosis 
made by the doctor, and are formed like a diagnostic 
support content object A60 shown in FIG. 15. Referring 
to FIG. 15, the diagnostic support content object A60 

10 is a software concept formed by combining various kinds 

of data and programs as needed, and is constituted by 
diagnostic support content specifying information A61 
which includes an ID, name, and the like for specifying 
the diagnostic support content, disease information A62 

15 which includes statistical information, diagnostic 

information, examination/treatment information, a 
plurality of cases, a characteristic value data list 
calculated from image data, and the like with respect 
to N disease types (N ^ 1) as diagnostic support 

20 targets, one or more pieces of reference image 

information A63 corresponding to each disease type, a 
characteristic value calculation library A64 for 
executing P types (P ^ 1) of characteristic value 
calculation techniques used for diagnostic support, an 

25 identification/classification library A65 for executing 

K types (K ^ 1) identification/classification 
techniques, and graph creation data A66 which is 



- 33 - 



referred to when a graph is created. The diagnostic 
support content object includes files and software 
libraries which implement a diagnostic support content. 
For example, the diagnostic support content is 
5 transmitted/received, saved, and selected by using 

these files and software. In addition, updating/ 
addition of a diagnostic support content include 
changes such as a partial version up with respect to 
the respective analysis techniques, statistical data, 

10 image data, and the like contained in the diagnostic 

support content. Only changed element items can be 
transmitted and received. 

Note that the diagnostic support content object 
does not always have all the elements shown in FIG. 15, 

15 but is designed to use only elements necessary for 

diagnostic support information to be created. 

As the diagnostic support content management 
information, in addition to the diagnostic support 
content specifying information such as the ID, name, 

20 and the like of the diagnostic support content object 

A60, date information such as creation date/update 
date, creator information, and other explanatory 
information are formed into a table and stored as a 
file. 

25 FIG. 3 is a view for explaining the arrangement of 

the diagnostic support execution terminal #3 in this 
embodiment. The diagnostic support execution terminal 
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#3 is constituted by a control means #12 for 
controlling the operation of the diagnostic support 
execution terminal #3 and creating diagnostic support 
information, an input/output control means #11 for 
5 controlling communication input/output operation 

through the network #4, a main program storage means 
#14 for storing the main program to be executed by the 
control means #12, a diagnostic support content storage 
means #13 for storing distributed diagnostic support 

10 contents and diagnostic support content management 

information, a terminal authentication information 
storage means #16 for storing terminal authentication 
information, e.g., a network address, user name, and 
ID, which are used to specify the diagnostic support 

15 execution terminal #3, a diagnostic information 

input/output control means #15 for acquiring diagnostic 
information concerning a patient, examination, and 
image which is obtained from the medical system #5, a 
display control means #17 for controlling display of 

20 created diagnostic support information, a display means 

#18 for displaying the created diagnostic support 
information, and an external input means #23 such as a 
keyboard or mouse which is used to input an instruction 
or the like from the operator. Referring to FIG. 3, 

25 the medical system #5 is constituted by an electronic 

clinical chart #21 connected to an in-hospital network 
#20 formed from a LAN or the like, an image file system 
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#22, and an endoscopic system #19 which is a modality 
for imaging in this embodiment. These medical systems 
#5 can exchange information with each other by using a 
common protocol such as DIC0M3 . 0 which has recently 
5 been widely used. The diagnostic support content 

storage means #13, main program storage means #14, and 
terminal authentication information storage means #16 
use a hard disk connected to the computer that 
implements the diagnostic support execution terminal 

10 #3. The control means #12 is operated by executing the 

main program using the CPU and main memory* 

The operation of the diagnostic support execution 
terminal #3, accompanying the creation and display of 
diagnostic support information, will be described next, 

15 FIG. 7 is a block diagram of a main program #51 

executed by the control means #12 of the diagnostic 
support execution terminal #3 according to this 
embodiment. This program includes a storage means 
management section #53 which controls a series of 

20 access operations accompanying storage, retrievals, 

reads, and the like with respect to the diagnostic 
support content storage means #13, a diagnostic 
information input/output I/F #56 serving as an 
interface for inputting/outputting diagnostic 

25 information constituted by patient information, 

examination information, and image information input 
through the diagnostic information input/output control 
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means #15, an input I/F #58 serving as an interface for 
inputting from the external input means #23 such as a 
keyboard or mouse, a diagnostic support information 
creating section #57 which creates diagnostic support 
5 information using the input diagnostic information and 

diagnostic support content, a terminal authentication 
information transmitting section #52 which transmits 
terminal authentication information to the diagnostic 
support content server #2, the storage means management 

10 section #53 which controls a series of access 

operations accompany storage, retrievals, reads, and 
the like with respect to the terminal authentication 
information storage means #16 and diagnostic support 
content storage means #13, a diagnostic support content 

15 communication section #55 which performs a series of 

communication activities with the diagnostic support 
content server, accompanying reception of a diagnostic 
support content, and a diagnostic support content 
management section #54 which stores the received 

20 diagnostic support content in the diagnostic support 

content storage means #13 through the storage means 
management section #53, and updates the diagnostic 
support content management information, 

FIGS . 16 and 31 are flowcharts for explaining a 

25 series of operations accompanying the creation of 

diagnostic support information and updating/addition of 
a diagnostic support content by the diagnostic support 



execution terminal #3 according to this embodiment. 
Assume that in creating diagnostic support information 
at the time of an examination, diagnostic support 
information is created and displayed on the display- 
means #18 upon reception of an image as a trigger from 
the endoscopic system #19 connected to the diagnostic 
support execution terminal #3 on the basis of the 
arrangement shown in FIG. 3. 

Referring to FIG. 16, in step S21, a diagnostic 
support content to be executed is set or updating/ 
addition of a diagnostic support content is selected. 
More specifically, the main program #51 displays a 
diagnostic support main menu window A200 shown in 
FIG. 27 on the display means #18. The main menu window 
A200 has a diagnostic support execution button A201 for 
executing diagnostic support in an examination, a 
diagnostic support content change/add button A202 for 
updating/adding a diagnostic support content through 
communication with the diagnostic support content 
server #2, and an end button A203 for ending the 
operation of the diagnostic support execution terminal. 
When each button is selected by using the external 
input means #23 such as a keyboard or mouse, the flow 
advances to the next operation step. In the main menu 
window A200, if the diagnostic support execution button 
A201 is selected, the flow advances to step S51 in 
FIG. 31. If the diagnostic support content change/add 



button A202 is selected, the flow advances to step ^ 
in FIG. 31. The following description is based on the 
assumption that the diagnostic support execution button 
A201 is selected. 

In step S51, examination condition settings tor a 
diagnostic support content to be executed are made 
The contents of the condition settings include items 
associated with an examination purpose and type. I„ 
this embodiment, they are the type of modality as 
equipment to be used for the examination and an 
examination region. The condition settings are made in 
an examination condition setting window A 21 0 shown in 
FIG. 28 which is displayed on the display means #18, 
and a modality selection menu A211 and examination 
region menu A212 which are pull-down menus are used 
in each menu, the previously set condition is displayed 
as an initial value, and the setting is changed, as 
needed, by operating the external input means ,23. 
After the condition setting, an OK button A213 is 
selected, and the flow advances to step S52. 

m step S52, a diagnostic support content setting 
window A220 is displayed, which is shown in FIG. 29 and 
used to select and set a diagnostic support content in 
accordance with the set modality type and examination 
region. The diagnostic support content setting „i„ d o„ 
A220 includes a diagnostic support content menu A221 
"hich displays a list of diagnostic support contents 



r 
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that can be applied to the diagnostic support execution 
terminal #3 in accordance with the conditions set in 
the step S51, and a selected state display area A222 
which indicates the selected/non-selected state of each 
5 diagnostic support content. A desired diagnostic 

support content is selected/non-selected (which is 
toggled with clicking of a mouse or the like) by 
operating the external input means #23 in the 
diagnostic support content menu A221. As an initial 

10 value, the selected state in the previous examination 

is reproduced. After a diagnostic support content is 
set, an examination start button A223 is selected. The 
flow advances to step S53. 

In step S53, the set diagnostic support content is 

15 loaded (prepared) . The main program #51 reads out a 

diagnostic support content object corresponding to the 
set diagnostic support content from the diagnostic 
support content storage means #13, loads necessary 
data, and links a characteristic value calculation 

20 technique library and identification/classification 

library to be used (They are implemented by a plug-in 
technique. Plug-in is a known technique generally used 
in Internet browsers and the like, and hence a detailed 
description will be omitted.), thereby completing 

25 preparations for the operation of the diagnostic 

support information creating section #57. The flow 
then advances to step S22 in FIG. 16. 
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In step S22, patient/examination information used 
for the set diagnostic support content is acquired from 
the endoscopic system #19, the electronic clinical 
chart #21 connected to the in-hospital network #20, the 
5 image file system #22, or the like. 

In step S23, as an input is input from the 
endoscopic system #19, image information is acquired. 

In step S24, the diagnostic support information 
creating section #57 creates diagnostic support 

10 information on the basis of the patient/examination 

information acquired in step S22 and the image 
information acquired in step S23. The diagnostic 
support information creating section #57 executes 
processing required to create the respective pieces 

15 of information shown in diagnostic support content 

examples ® to (D, e.g., calculation of characteristic 
values corresponding to diagnostic support contents, 
execution of identification/classification processing, 
and creation of statistical information/graphs, and 

20 creates a display window. 

In step S25, the created diagnostic support 
information is displayed on the display means #18. 
FIG. 32 shows a display example of a diagnostic support 
execution window. A diagnostic support execution 

25 window A250 is formed as a multi-window display window 

and includes a patient/examination/image information 
display window A251 for displaying patient/examination 
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information, the original image input from the 
endoscopic system #19, and the like, and one or more 
diagnostic support information display windows A252 for 
displaying diagnostic support information based on 
5 the set diagnostic support content. In addition, 

region-of-interest information A253 indicating a region 
of interest in which a characteristic value is to be 
calculated by using an image analysis technique is 
superimposed on the original image displayed in the 

10 patient/examination/image information display window 

A251. The doctor conducts an examination by referring 
to these pieces of patient/examination/image informa- 
tion and diagnostic support information. 

If it is determined in step S26 that diagnostic 

15 support is terminated, the processing is terminated. 

Otherwise, step S23 and the subsequent steps are 
repeated with respect to the next image information 
input from the endoscopic system #19. When this 
processing is to be terminated, an examination end 

20 button A254 in the diagnostic support execution window 

A250 is selected. The main program #51 displays the 
diagnostic support main menu window A200 again to 
prepare for the next examination or the like. 

Operation to be done when the diagnostic support 

25 content change/add button A202 is selected in the 

diagnostic support main menu window A200 in step S21 
will be described next. The main program #51 starts 
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updating/adding a diagnostic support content by 
performing a series of operations including 

communication with the diagnostic support content 
server #2. 

First of an, in step S54, a diagnostic support 

content server is selected. A diagnostic support 

content server is selected in a diagnostic support 

content server selection window A260 in FIG. 33. The 

diagnostic support content server selection • 

ei selection window A260 

includes a modalitv m^nn no^i 

nty menu A261 and examination region 

m enu A262 „ hich are pull _ down seiecti ^ ^ 

modality and examination region as conditions for a 
diagnostic support content, a diagnostic support 
content menu A263 which displays a list of diagnostic 
support content servers, and a selected state display 
area A264 which indicates the selected/non-selected 
state of each diagnostic support content server, when 
an OK button A265 is selected after the respective 
■nenus are set by operating the external input means 
#23, the flow advances to step S55. 

m step S55, self-terminal authentication 
information is transmitted to the selected diagnostic 
support content server. m this case, a terminal 
authentication information setting window A230 shown in 
FIG. 30 is used. The terminal authentication informa- 
tron setting window A230 includes a facility name input 
button A231, terminal name input box A232, I D i nput box 
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A233, and password input box A234 which are respec- 
tively used to input a facility name, terminal name, 
ID, and password. Such pieces of information are input 
by using the external input means #23. These pieces 
5 of information are stored as terminal authentication 

information in the terminal authentication information 
storage means #16, and are set as initial values in the 
input boxes except for a password. When an OK button 
A235 is selected after each information is input, the 

10 main program #51 transmits the information to the 

diagnostic support content server #2 through the 
input/output control means #11, and acquires a terminal 
authentication result. The diagnostic support content 
server #2 collates the terminal authentication 

15 information stored in the distribution destination 

management file storage means #8 with the received 
terminal authentication information to determine 
whether to allow establishment of communication, and 
transmits the result. If establishment of communi- 

20 cation is allowed, communication concerning 

updating/addition of a diagnostic support content with 
the diagnostic support execution terminal #3 is 
established. If establishment of communication is 
inhibited, a message indicating the reason is 

25 transmitted. 

If it is determined in step S56 that the 
diagnostic support execution terminal #3 has been 
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normally authenticated by the diagnostic support 
content server #2 and communication has been 
established, the flow advances to step S57. If 
communication cannot be established for some reason (a 
5 problem in a communication line, the expiration of a 

password, or the like) , the flow advances to step S62 
to display an error together with the received message. 

In step S57, after the diagnostic support content 
management information held in the diagnostic support 

10 content server #2 is acquired, the diagnostic support 

content management information for specifying a 
diagnostic support content for which updating/addition 
is to be performed is referred to. The main program 
#51 generates, through the diagnostic support content 

15 communication section #55, a request to acquire the 

diagnostic support content list information stored in 
the diagnostic support content storage means #6 of 
the diagnostic support content server #2. The list 
information conforms to the diagnostic support content 

20 management information held in the diagnostic support 

content server #2 and includes the following informa- 
tion in the form of a list: diagnostic support content 
specifying information such as the ID and name of the 
diagnostic support content, date information such as 

25 creation/update date, creator information, and other 

explanatory information. The diagnostic support 
content server #2 creates diagnostic support content 
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list information using a diagnostic support content 
list creating section #47, and transmits it to the 
diagnostic support execution terminal #3. on the basi 
of comparison between the stored diagnostic support 
content management information and the received 
diagnostic support content list information, the 
diagnostic support content management section #54 
selects a diagnostic support content for which 
updating, addition, or the like has been done. An 
update/add menu window A7! for updating and addition 
of data for the diagnostic support content shown in 
FIG. 17 is created with respect to the selected 
diagnostic support content, and is displayed on the 
display means #18. Referring to FIG . 17, the 
update/add menu window A71 includes a menu area A72 for 
displaying a list of updated and added diagnostic 
support contents and selecting a diagnostic support 
content therefrom, a cancel button A74, an OK (start, 
button A73, an all selection button A75 for setting all 

the diagnostic support contents in t-h* m~ 

e ics in the menu area A72 in 

the selected state, and a mouse cursor A76 for 

selecting a menu and clicking a button. 

in step S58, a desired diagnostic support content 
- selected from the menu area A72 or the all selection 
button A75 is selected to set all the diagnostic 
support contents in the selected state. 

In step S59, the OK button A73 in t-h 

Lon A/J ln the menu window 
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A71 in FIG. 17 is selected to cause the diagnostic 
support content communication section #55 to transmit 
diagnostic support content specifying information such 
as the ID and name of the selected diagnostic support 
5 content to the diagnostic support content server #2 and 

generate a transmission request. Upon reception of 
this request, the diagnostic support content server #2 
transmits the requested diagnostic support content. 

After the diagnostic support content is completely 

10 received, the diagnostic support content management 

section #54 updates the diagnostic support content 
management information and stores the updated infor- 
mation in the diagnostic support content storage means 
#13 together with the received diagnostic support 

15 content in step S60. The processing is then 

terminated, and the flow returns to step S21. 

As described above, according to the diagnostic 
support apparatus of the first embodiment of the 
present invention, the diagnostic support execution 

20 terminal #3 can selectively obtain diagnostic support 

information in accordance with an examination purpose 
and type, and a latest diagnostic support content can 
be used. 

[(l-B)th Embodiment] 
25 A diagnostic support apparatus according to the 

(l-B)th embodiment of the present invention will be 
described next with reference to the views of the 



47 - 



10 



15 



20 



25 



accompanying rendering. This embodiment relates to a 
diagnostic support apparatus which allows a diagnostic 
support execution terminal #3 to always use a latest 
diagnostic support content. 

The form of the diagnostic support apparatus 
according to this embodiment is the same as that of the 
diagnostic support apparatus according to the first 
embodiment shown in FIG. 1. m addition, a diagnostic 
support content server #2 and the diagnostic support 
execution terminal #3 have the same arrangements as 
those in the first embodiment, and different operation 
is implemented by changing main programs #31 and #51 
for the respective operations. 

In this embodiment, upon detecting that a 
diagnostic support content is updated or added, the 
diagnostic support content server #2 distributes the 
updated or added diagnostic support content to the 
predetermined diagnostic support execution terminal #3. 

The operation of the diagnostic support content 
server #2 which is associated with diagnostic support 
content distribution in this embodiment will be 
described with reference to FIGS. 4, 5, and 6. FIG. 5 
is a block diagram showing a diagnostic support content 
distribution executing section #32 in more detail, 
which is comprised of an input/output control means I/F 
#41 which serves as an interface with an input/output 
control means #10 to communicate with the diagnostic 



- 48 - 



support execution terminal #3 through a network #4, a 
diagnostic support content designating section #42 
which designates diagnostic support content distribu- 
tion, a diagnostic support content updating/addition 
5 detecting section #43 which detects updating/addition 

of a diagnostic support content stored in a diagnostic 
support content storage means #6, a diagnostic support 
content management means #44 for managing the 
diagnostic support content management information 

10 stored in the diagnostic support content storage 

means #6, a diagnostic support execution terminal 
authenticating section #45 which specifies and 
authenticates a diagnostic support execution terminal 
as a distribution destination, a diagnostic support 

15 content selecting section #46 which selects and 

designates a diagnostic support content to be 
distributed, and a diagnostic support content list 
creating section #47 which creates information of a 
list of diagnostic support contents that can be 

20 distributed. 

FIG. 6 is a flowchart for explaining a series of 
operations in distributing a diagnostic support content 
in this embodiment. In step SI, the diagnostic support 
content updating/addition detecting section #43 detects 

25 that the diagnostic support content stored in the 

diagnostic support content storage means #6 are updated 
or added. This detection is executed by making the 
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diagnostic support content updating/addition detecting 
section #43 refer to the diagnostic support content 
management information acquired by the diagnostic 
support content management means #44 and detect a 
5 change in the date information of the diagnostic 

support content or the contents of file information. 
On the basis of the detection result, the diagnostic 
support content updating/addition detecting section #43 
notifies the diagnostic support content designating 

10 section #42 of the occurrence of the diagnostic support 

content to be distributed. 

In step S2, the updated/added diagnostic support 
content is acquired. In this case, the diagnostic 
support content selecting section #46 selects the 

15 updated/added diagnostic support content, and acquires 

the content from the diagnostic support content 
storage means #6 through a storage means management 
section #33. 

In step S3, a diagnostic support execution 

20 terminal as a distribution destination is specified. 

In this case, the diagnostic support execution terminal 
authenticating section #45 accesses a distribution 
destination management file storage means #8 through 
the storage means management section #33 to acquire 

25 terminal specifying information such as the network 

address of the diagnostic support execution terminal as 
the distribution destination, a facility name, and a 
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password. 

In step S4, the distribution destination terminal 
is authenticated by using the distribution destination 
terminal authentication information obtained in step 
5 S3. In this case, the diagnostic support execution 

terminal authenticating section #45 compares the 
distribution destination terminal authentication 
information with the terminal authentication 
information of the diagnostic support execution 

10 terminal #3 which is obtained through the input/output 

control means I/F #41 and network #4. If it is 
determined upon completion of authentication that 
distribution can be done, the flow advances to step S5. 
If the terminal authentication information cannot be 

15 recognized for some reason and it is determined that 

distribution is inhibited, the flow advances to 
step S6. 

In step S5, the diagnostic support content is 
distributed through the input/output control means I/F 

20 #41 in accordance with an instruction from the 

diagnostic support content designating section #42. 

In step S6, the diagnostic support content 
designating section #42 checks whether the processing 
is completed with respect to all the diagnostic support 

25 execution terminals as the distribution destinations 

specified in step S3. If YES in step S6, the series of 
operations is terminated. If NO in step S6, the series 



51 - 



of operations in steps S4 to S6 is executed again. 

The operation of the diagnostic support execution 
terminal #3, accompanying the distribution of a 
diagnostic support content, will be described next with 
5 reference to FIGS. 7 and 8. 

FIG* 8 is a flowchart for explaining a series of 
operations of the diagnostic support execution terminal 
#3, accompanying the reception of the diagnostic 
support content, in this embodiment. Also refer to 

10 FIG. 6 in association with the operation of the 

diagnostic support content server #2. 

Accompanying the distribution of a diagnostic 
support content by the diagnostic support content 
server #2 shown in FIG. 6, processing is started upon 

15 communication establishment in the distribution 

destination terminal specifying processing in step S3. 
In step Sll in FIG. 8, a terminal authentication 
information transmitting section #52 acquires the 
terminal authentication information stored in a 

20 terminal authentication information storage means #16 

by instructing a storage means management section #53 
to acquire terminal authentication information, and 
transmits the information to the diagnostic support 
content server #2 through an input/output control 

25 means #11. 

In step S4 in FIG. 6, the terminal is 
authenticated as a distribution destination terminal. 
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The flow then advances to step S5 to start transmitting 
the diagnostic support content. The operation of the 
diagnostic support content server #2 at this time 
corresponds to the reception of the diagnostic support 
5 content in step S12. A diagnostic support content 

communication section #55 operates through the 
input/output control means #11. 

In step S13, a diagnostic support content 
management section #54 updates the diagnostic support 

10 content management information. In step S14, the 

diagnostic support content management section #54 
stores the diagnostic support content and diagnostic 
support content storage information in a diagnostic 
support content storage means #13, thus terminating the 

15 series of operations. 

As described above, according to the diagnostic 
support apparatus of the (l-B)th embodiment of the 
present invention, as a diagnostic support content 
in the diagnostic support content server #2 is 

20 updated/ added, the content is distributed to the 

diagnostic support execution terminal #3. This makes 
it possible to always use a latest diagnostic support 
content for an examination. 
[(l-C)th Embodiment] 

25 A diagnostic support apparatus according to the 

(l-C)th embodiment of the present invention will be 
described next with reference to the several views of 
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the accompanying rendering. This embodiment relates 
to a diagnostic support apparatus which allows a 
diagnostic support execution terminal #3 to always use 
a latest diagnostic support content with ease. More 
specifically, the diagnostic support execution terminal 
•3 -axes an inguiry as to whether a diagnostic support 
content is updated or added, and generates a transmis- 
sion request if a content is updated or ^ 

The form of the diagnostic support apparatus 
according to this embodiment is the same as that of the 
diagnostic support according to the first embodiment 
shown in FIG. !. In addltion> , diagnostic 

content server #2 has the same arrangement as that in 
the first embodiment, and different operation is 
implemented by changing . main program #31 _ 
the diagnostic support execution terminal « has almost 
the same arrangement as that in the first embodiment 
except that in addition to the constituent elements 
shown i„ FIG . 7, the terminal further includes an 
update/add inguiry information storage means #60 for 
storing, for example, a condition setting f Ue for 
inquiring the diagnostic support content server #2 
wither a diagnostic support content is updated/added, 
as shown in FIG ~u 

* 36 ' By cha *gmg a main program #51, 

predetermined operation can be implemented. 

FIG. 37 is a flowchart for explaining the 
operation of the diagnostic support execution terminal 
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#3 which is associated with updating/addition of a 
diagnostic support content in this embodiment. When 
the diagnostic support execution terminal #3 is started 
(the power is turned on to start the main program) , 
5 each of the following processes is executed by the main 

program #51. The operation is mainly performed by a 
diagnostic support content management section #54. 

First of all, in step S71, an update/add inquiry 
information file in which various setting information 

10 concerning updating/addition of a diagnostic support 

content with respect to the diagnostic support content 
server #2 is written is acquired from the update/add 
inquiry information storage means #60 through a storage 
means management section #53. FIG. 38 shows an example 

15 of the contents of the add/update inquiry information 

file. Referring to FIG. 38, an update/add inquiry 
information file A290 includes timing setting infor- 
mation A291 for setting a specific timing at which an 
inquiry is made to the diagnostic support content 

20 server #2, and content setting information A292 for 

setting the execution of an inquiry about a specific 
diagnostic support content with respect to a specific 
diagnostic support content server. An inquiry timing 
is set to, for example, the time of occurrence of some 

25 event such as startup or end of an examination, a 

periodic time setting such as two-hour intervals, or a 
specific timing setting such as 15:00. Content setting 
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information is set such that information such as an ID 
for specifying a diagnostic support content server 
is associated with information such as an ID for 
specifying a diagnostic support content, and if "ALL" 
5 is set, all the diagnostic support contents are set as 

inquiry targets. In addition, information representing 
a modality as a target for a diagnostic support 
content, an examination region, and the like can be 
used. Information such as "no inquiry should be made 
10 during an examination" can also be set as a flag. Note 

that an update/add inquiry information file is created 
and edited using a setting window and text editor (not 
shown) . 

In step S72, it is checked whether an inquiry to 
15 the diagnostic support content server #2 is started. 

If, for example, the inquiry timing is set to the time 
of startup, the flow immediately advances to step S73. 
If. the time setting or the like indicates that the 
current time is not the timing of starting an inquiry, 
20 the flow advances to step S83. 

In step S73, the diagnostic support content server 
#2 is selected on the basis of the content setting 
information loaded in step S71. In the case shown in 
FIG. 38, since three diagnostic support content servers 
25 are set, inquires are sequentially made to the 

respective servers . 

In steps S74 and S75, communication with the 
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target diagnostic support content server is established 
by processing similar to that in each of steps S55 and 
S56 described in association with the operation of the 
diagnostic support execution terminal #3 in the first 
5 embodiment. If communication establishment fails, 

the flow advances to step S81. Otherwise, the flow 
advances to step S78. 

In step S81, error information including a message 
concerning the communication establishment error 

10 transmitted from the diagnostic support content server 

and the like is displayed on a display means #18, and 
an error log file is output, as needed. The flow then 
advances to step S82. 

In step S76, a diagnostic support content which 

15 has been updated/added is confirmed by the same 

processing as that in step S57 in the first embodiment. 

In step S77, by further referring to the 
diagnostic support content which is recognized as an 
updated/added content in step Si 6 and the update/add 

20 inquiry information file, the diagnostic support 

content to be distributed by the diagnostic support 
content server #2 is selected. 

In steps S78, S79, and S80, processing similar to 
that in steps S59, S60, and S61 described in the first 

25 embodiment is performed to receive the diagnostic 

support content and store the diagnostic support 
content management information in a diagnostic support 
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content storage means #13 upon updating the infor- 
mation. 

In step S82, it is checked whether inquires to all 
the set diagnostic support content servers #2 are 
completed. If NO in step S82, the flow returns to step 
S73 to repeat the subsequent processing. If YES in 
step S82, the flow advances to steps S83 and S84. 

In step S83, the diagnostic support execution 
terminal #3 is set in the standby state with respect to 
an inquiry to the diagnostic support content server #2. 
The diagnostic support content management section #54 
repeats end determination in step S84 and inquiry start 
determination in step S72 at, for example, periodic 
intervals by using time information from the system 
clock and OS. During this period, in practice, the 
diagnostic support execution terminal #3 operates 
to provide diagnostic support information in an 
examination. If an instruction to end the main program 
#51 is issued, the operation is terminated through the 
determination in step S84. 

At the set inquiry timing, a series of operation 
in step S73 and the subsequent steps is executed. 

As described above, according to the diagnostic 
support apparatus of the (l-C)th embodiment of the 
present invention, a latest diagnostic support content 
can always be used by inquiring a diagnostic support 
content server about updating/addition of a diagnostic 
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support content on the basis of set information. 
[Second Embodiment] 

The second embodiment of the present invention 
will be described with reference to the several views 
5 of the accompanying rendering. This embodiment will 

exemplify a diagnostic support apparatus which allows 
many medical facilities/organizations to freely create 
a diagnostic support content, allows the wide use of 
various medical information, image data, and expert 

10 medical knowledge accumulated in the respective 

facilities/organizations on diagnostic support 
apparatuses, and can improve the performance of the 
diagnostic support apparatus by effectively using case 
data dispersed in many medical facilities/organizations 

15 because, for example, data can be easily added to 

created a diagnostic support content. 

FIG. 18 shows a form of the diagnostic support 
system according to the second embodiment of the 
present invention. Referring to FIG. 18, reference 

20 numeral #101 denotes a diagnostic support system 

according to the second embodiment of the present 
invention. Reference numerals #2 to #5 denote the same 
constituent elements as in the first embodiment shown 
in FIG. 1. This embodiment further includes a 

25 diagnostic support content creating terminal #102 for 

creating a diagnostic support content distributed by 
the diagnostic support content server #2 and used by 
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the diagnostic support execution terminal #3, and a 
diagnostic support content creating tool server #103 
which provides a diagnostic support content creating 
tool for creating a diagnostic support content. 

The diagnostic support content creating terminal 
#102 and diagnostic support content creating tool 
server #103 are also computers, each having a display 
means such as a CRT or LCD and input means such as a 
keyboard and mouse. For the sake of convenience, 
FIG. 18 shows an arrangement in which one each of the 
diagnostic support content server, diagnostic support 
execution terminal, diagnostic support content creating 
terminal, and diagnostic support content creating tool 
server is connected to the network, but pluralities of 
such servers and terminals may exist on the same 
network . 

The diagnostic support content creating terminal 
#102 is installed in a hospital/clinic or medical 
institute to create a diagnostic support content using 
the diagnostic information obtained by the medical 
system #5 connected to the LAN, as in the case of the 
diagnostic support execution terminal #3, and transmit 
the content to the diagnostic support content server 
#2. In addition, the diagnostic support content 
creating terminal #102 receives a diagnostic support 
content that have already existed in the diagnostic 
support content server #2, updates/improves the content 



- 60 - 



by, for example, adding new data or disease information 
as a diagnosis target, and transmits the resultant 
content to the diagnostic support content server #2. 
The diagnostic support content creating tool 
5 server #103 provides various types of image processing/ 

analysis/characteristic value calculation techniques, 
identification/classification techniques such as a 
discrimination function and neural network, statistical 
test techniques such as t test, various multivariate 

10 analysis techniques, graph creating tools, and the like 

in the form of software libraries, which are used by 
the diagnostic support content creating terminal #102 
to create a diagnostic support content. 

FIG. 19 is a view for explaining the arrangement 

15 of the diagnostic support content creating terminal 

#102 in this embodiment. The arrangement of the 
diagnostic support content creating terminal #102 is 
almost the same as that of the diagnostic support 
execution terminal #3. The same reference numerals as 

20 in FIG. 19 denote the same constituent elements in 

FIG. 3. The diagnostic support content creating 
terminal #102 further includes a diagnostic support 
content creating tool storage means #111 which stores 
the above diagnostic support content creating tool. 

25 The diagnostic support content creating tool storage 

means #111 uses the hard disk connected to the computer 
realizing the diagnostic support content creating 
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terminal #102, as well as a diagnostic support content 
storage means #13, main program storage means #14, and 
terminal authentication information storage means #16. 

The operation of creating a diagnostic support 
content in the diagnostic support content creating 
terminal #102 will be described next. 

FIG. 20 is a block diagram of a main program #121 
executed by a control means #12 of the diagnostic 
support content creating terminal #102 in this 
embodiment. Referring to FIG. 20, the main program 
#121 includes a storage means management section #123 
which controls a series of access operations accom- 
panying storage, retrievals, reads, and the like with 
respect to pieces of information stored in the 
diagnostic support content storage means #13, terminal 
authentication information storage means #16, and 
diagnostic support content creating tool storage means 
#111, a diagnostic support information input/output I/F 
#12 6 which inputs/outputs diagnostic information 
constituted by patient information, examination 
information, and image information input through a 
diagnostic information input/output control means #15, 
an input I/F #128 serving as an interface for inputting 
information from an external input means #23 such as 
a keyboard or mouse, a diagnostic support content 
creating section #127 for creating a diagnostic support 
content using the input diagnostic information and 
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diagnostic support content creating tool, a terminal 
authentication information transmitting section #122 
which transmits terminal authentication information to 
the diagnostic support content server #2 and diagnostic 
5 support content creating tool server #103, a diagnostic 

support content communication section #125 for 
performing a series of communication operations with 
the diagnostic support content server #2, accompanying 
transmission/reception of a diagnostic support content, 

10 and with the diagnostic support content creating tool 

server #103, accompanying reception of a diagnostic 
support content creating tool, and a diagnostic support 
content management section #124 which stores the 
received diagnostic support content and diagnostic 

15 support content creating tool in the diagnostic support 

content storage means #13 and diagnostic support 
content creating tool storage means #111, respectively, 
through the storage means management section #123, 
and updates the respective pieces of management 

20 information. 

FIG. 21 is a flowchart for explaining the flow of 
a series of operations in creating a diagnostic support 
content. In step S41, a data set is created. In this 
case, the data set is a set of various data (patient 

25 information, examination information, image infor- 

mation, diagnosis result information, and the like) and 
creation conditions (the type of diagnostic support 
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content, diagnostic support content creating tool to be 
used, and the like) which are required for the creation 
of a diagnostic support content. Assume that the 
diagnostic support content described with reference to 
FIG . 9 is to be created. The data to be used are 
"endoscopic image data diagnosed as normal and 
gastritis", which are acquired from, for example, an 
electronic clinical chart #21 and image file system #22 
connected to the medical system #5. The creation 
conditions to be used are "IHb value calculation, 
statistical information of normal and gastritis groups, 
occurrence probability distribution calculation, and 
graph creation" . 

More specifically, first of all, a diagnostic 
support content creating main window A27 0 shown in 
FIG. 34 is displayed on a display means #18. The 
diagnostic support content creating main window A270 
includes a new creation button A271 for creating a new 
diagnostic support content, an existing content use 
button A272 for calling out diagnostic support content 
stored in the diagnostic support content storage means 
#13 to create a diagnostic support content by reusing 
the data and conditions, and an end button A273 for 
ending diagnostic support content creation. 

When the new creation button A271 is selected in 
the diagnostic support content creating main window 
A27 0, windows for creating a data set shown in FIG. 22 
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are displayed on the display means #18, and condition 
selection, information input operation, and the like 
are performed by using the external input means #23 
such as a keyboard and mouse. 

When the existing content use button A272 is 
selected, a call diagnostic support content selection 
window A140 shown in FIG. 26 is displayed. The call 
diagnostic support content selection window A140 
includes a diagnostic support content name display area 
A141 which displays a list of diagnostic support 
contents that can be called out from the diagnostic 
support content storage means #13 on the basis of the 
diagnostic support content management information, and 
also functions as a menu. A diagnostic support content 
to be called out is selected by clicking a mouse cursor 
A142. Subsequently, when a confirm button A143 is 
clicked, a diagnostic support content creating section 
#127 reads out the selected diagnostic support content 
from the diagnostic support content storage means #13, 
and displays the respective pieces of information used 
for the creation in the respective setting areas (to be 
described later) in a data set creating window A101 
upon setting them on the basis of the contents of a 
diagnostic support content object A60 forming the 
diagnostic support content. The respective set 
contents can be reused by, for example, changing the 
target disease and adding case data as needed. 



Referring to FIG. 22, the data set creating window 
A101 is constituted by a data set name input area A102 
for inputting a data set name (which coincides with 
the name of a diagnostic support content in this 
embodiment) , a target diagnosis name setting area A103 
for setting the type of disease as a diagnostic support 
target, a working characteristic value calculation 
technique setting area A104 for setting a charac- 
teristic value calculation technique to be used, a 
working identification/classification technique setting 
area A105 for setting an identification/classification 
technique to be used, a calculation statistical data 
setting area A106 for setting statistical data to be 
calculated, a creation graph setting area A107 for 
setting a graph to be created, an examination condition 
setting button A108 for setting a modality, examination 
region, and the like, a text information input button 
A109 for inputting findings used for diagnostic support 
and text information of a treatment and the like, a 
reference image setting button for setting typical case 
data and similar case data corresponding to each 
diagnosis, an existing content call button Alll (which 
facilitates switching to the mode of reusing an 
existing content even after the new creation mode is 
selected) for calling out a diagnostic support content 
when, for example, adding data and changing creation 
conditions on the basis of an existing diagnostic 
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support content, and a confirm button A112 for 
confirming data set creation. 

Reference numerals A113 to A117 denote a target 
diagnosis name selection window, characteristic value 
5 calculation technique selection window, identification/ 

classification technique selection window, statistical 
data selection window, and graph selection window, 
respectively, which are windows for selecting various 
times with respect to the setting areas A103 to A107. 

10 In these selection windows, various types of diagnostic 

support content creating tools which are stored in the 
diagnostic support content creating tool storage means 
#111 and can be used by the diagnostic support content 
creating section #127 are displayed as menus. These 

15 tools can be input to the respective setting areas A103 

to A107 by double-clicking with a mouse cursor #A118 or 
drag-and-drop operation to the corresponding setting 
areas. In addition, the respective types of diagnostic 
support content creating tools set in the respective 

20 setting areas A103 to A107 can be canceled by 

double-clicking them. 

When the examination condition setting button A108 
is clicked, an examination condition setting window 
A120 shown in FIG. 23 is displayed to allow the 

25 operator to set a modality and examination region for 

the diagnostic support content to be created. 

When the text information input button A109 is 
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clicked, a text information setting window A125 shown 
in FIG. 24 is displayed to allow the operator to input 
important findings and medical knowledge such as a 
procedure/treatment instruction and the like for each 
disease type in the form of text information using the 
external input means #23 such as a keyboard. 

When a reference image setting button A110 is 
clicked, a reference image setting window A130 shown in 
FIG. 25 is displayed. In the reference image setting 
window A130, for example, image data retrieved and 
acquired from the image file system #22 connected to 
the medical system #5 is displayed in an image list 
A131. In the image list A131, a desired image is 
selected as a reference image. When an information 
confirm/add button A132 is clicked, the patient 
information, examination information, and image 
information acquired together with the image from the 
image file system #22 can be checked, and additional 
information such as a comment can be added. 

When the existing content call button Alll is 
clicked in creating a data set, the call diagnostic 
support content selection window A140 shown in FIG. 26 
is displayed. The operator then makes a series of 
settings as in the case wherein the existing content 
use button A272 is selected. 

After a data set is created in step S41, it is 
checked in step S42 whether to use a characteristic 
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value obtained by using an image analysis technique. 
If a characteristic value calculation technique is set 
in the working characteristic value calculation 
technique setting area A104 in step S41, the flow 
advances to step S43. If no technique is set in this 
area, the flow advances to step S44. 

In step S43, the characteristic value set in the 
working characteristic value calculation technique 
setting area A104 is calculated. An image corre- 
sponding to the diagnosis set in the target diagnosis 
name setting area A103 is retrieved and acquired from 
the image file system #22, and a characteristic value 
is calculated by using the characteristic value 
calculation technique library acquired from the 
diagnostic support content creating tool storage 
means #111. 

In step S44, a diagnostic support content is 
created by executing the respective types of libraries 
acquired from the diagnostic support content creating 
tool storage means #111 using the respective set items, 
acquired diagnostic data, and calculated characteristic 
values. The diagnostic support content is completed as 
a diagnostic support content object together with a 
library necessary for execution on the diagnostic 
support execution terminal #3, and are stored in the 
diagnostic support content storage means #13 after the 
diagnostic support information management information 
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is updated. 

The created diagnostic support content is 
transmitted to the diagnostic support content server #2 
through the network #4. In transmission and reception 
between a diagnostic support content creating terminal 
#202 and the diagnostic support content server #2, 
terminal specifying information is recognized, a 
diagnostic support content is transmitted and received, 
the diagnostic support content management information 
in the diagnostic support content server is updated, 
and a diagnostic support content is stored. 

A diagnostic support content creating tool used in 
the diagnostic support content creating terminal #202 
can be acquired from the diagnostic support content 
creating tool server #203 through the network #4. A 
latest diagnostic support content creating tool can be 
used in accordance with an improvement, addition, or 
the like. Note that the operation accompanying the 
transmission and reception of a diagnostic support 
content and diagnostic support content creating tool is 
similar to distribution and reception of a diagnostic 
support content described in the first embodiment, and 
hence a detailed description thereof will be omitted. 

In this embodiment, the diagnostic support content 
server #2, diagnostic support execution terminal #3, 
diagnostic support content creating terminal #102, and 
diagnostic support content creating tool server #103 
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have been described as independent computers. However, 
they can be implemented on one computer by integrating 
the respective functions. 

in addition, diagnostic support content creating 
tools and a diagnostic support content are software. 
Obviously, therefore, they can be acquired by using 
media such as floppy disks as well as being transmitted 
and received through a network. 

As described above, according to the diagnostic 
support apparatus of the second embodiment of the 
present invention, many medical facilities/ 
organizations can freely create a diagnostic support 
content, and various medical information, image data, 
and expert medical knowledge accumulated in the 
respective facilities/organizations can be widely used 
on diagnostic support apparatuses. m addition, since 
addition of data and the like can be done with respect 
to the created diagnostic support content, the 
performance of the diagnostic support apparatus can be 
improved by effectively using case data dispersed in 
many medical facilities/organizations. In the 
arrangement of the diagnostic support apparatus 
according to this embodiment, for example, the 
diagnostic support content list menu shown in FIG. 35 
is used in place of the menu shown in FIG. 17 when a 
diagnostic support content is to be acquired. 
Referring to FIG. 35, the names of 
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facilities/organizations which have created diagnostic 
support contents are added to a menu area A281 which is 
displayed in an update/add menu window A280 and used to 
display a list of diagnostic support contents and 
5 select a content. Therefore, each hospital/clinic 

which uses these data for an actual clinical examina- 
tion can know that, for example, a given content is 
created by "most advanced research facility for cancer 
of the large intestine", and can use the content with 
10 high reliability. 

[Third Embodiment] 

The third embodiment of the present invention will 
be described with reference to the several views of 
the accompanying rendering. The third embodiment is 
the same as the second embodiment except that the 
arrangement of the diagnostic support content creating 
section #127 in the second embodiment is different from 
that in the third embodiment, and an image information 
holding means 151 is added. FIG. 39 is a block diagram 
of a main program #121 showing the arrangement of a 
diagnostic support content creating section #127 
according to the third embodiment of the present 
invention. The difference between the second and third 
embodiments will be described below. 

The image information holding means 151 is formed 
from a hard disk and holds pieces of image information. 
FIG. 40A shows the format of image information. 
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Image information is constituted by image data, 
region-of-interest data, and accompanying data. The 
image data is digital data of an image signal output 
from a medical system #5, and is acquired through a 
5 diagnostic information input/output control means #15. 

The region-of-interest data is an area for charac- 
teristic value calculation with respect to the image 
data. The accompanying data is constituted by the 
patient/examination information acquired through the 

10 diagnostic information input/output control means #15 

and the information set by a diagnostic support 
execution terminal #3. In this embodiment, the 
patient/examination information of the accompanying 
data includes an image ID, patient ID, patient name, 

15 examination name, examination date, patient sex, and 

patient age. The information set by the diagnostic 
support execution terminal #3 includes a category 
classification, graph display attribute, diagnosis 
name, examination region, characteristic value 

20 information constituted by a characteristic value and 

characteristic value calculation parameter, arbitrary 
set character string items 1 to Q (Q ^ 1), and 
arbitrary set numerical value items 1 to R (R ^ 1). 
Of the respective items included in the 

25 accompanying data, the items other than the image ID, 

patient ID, patient name, and examination date items 
are held after being classified to a classification key 



73 - 



item and numerical value item. 

The items classified to the classification key 
item are the category classification, graph display 
attribute, diagnosis name, examination region, patient 
5 sex, and arbitrary set character string items 1 to Q. 

The items classified to the numerical value item 
are the characteristic value information, patient age, 
and arbitrary set numerical value items 1 to R. 

An image information holding means Tl holds 

10 management information of each item contained in image 

information and auxiliary information to be used for 
processing in the diagnostic support content creating 
section #127. 

FIG. 40B shows the contents of item management 

15 information. The information stored as item management 

information includes item name information of an item 
classified to the classification key item, item name 
information of an item classified to the numerical 
value key item, and information associated with the 

20 item value stored in each of the classification key 

items of the accompanying data. For example, as the 
item value information of a diagnosis name, information 
such as "normal, cancer, polyp, ..." is stored. As 
item management information, pieces of item name 

25 information corresponding to the arbitrary set 

character string items 1 to Q and arbitrary set 
character string items 1 to R are stored. 
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FIG. 40C shows the contents of the auxiliary 
information. As graph type information, the name 
information of the graph type created by the diagnostic 
support content creating section #127 is stored. As 
statistic type information, the type name information 
of a statistic computed by the diagnostic support 
content creating section #127 is stored. As 
statistical test type information, the type name 
information of the statistical test computed by the 
diagnostic support content creating section #127 is 
stored. 

FIG. 39 is a block diagram of a main program #51 
executed by a control means #12. An illustration of 
an arrangement that is not used for the following 
description is omitted. 

A storage means management section #123 controls a 
series of access operations accompanying storage, 
retrievals, reads, and the like of image information 
with respect to the image information holding 
means 151. 

A graph information creating section 152 creates 
graph information from the image information held in 
the image information holding means 151. The graph 
information creating section 152 includes an item 
selecting section 153, classified data set creating 
section 156, statistical processing section 155, and 
graph processing section 154. 
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The classified data set creating section 156 
classifies image information into a plurality of 
classified data sets on the basis of the classification 
information set by the item selecting section 153. 

A classified data set is a data set of image 
information classified according to the values of the 
classification key items of the accompanying data 
contained in the image information. 

The statistical processing section 155 
statistically processes the numerical value items 
contained in a classified data set, and outputs the 
processing result to the graph processing section 154. 
The item selecting section 153 designates a specific 
numerical value item, in the image information in the 
classified data set, for which statistical processing 
is to be performed, and a specific type of statistical 
processing to be performed. 

In this embodiment, the statistical processing 
section 155 processes at least one of statistics such 
as an average value, standard deviation, standard 
error, intermediate value, and mode value, or processes 
at least one of statistical test such as t test and % 2 
test . 

The graph processing section 154 creates graph 
information from a numerical value item contained in 
the classified data set, superimposes statistical 
processing results on the graph information, and 
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displays the graph information on a display means #18 
through a display control means #17. The item 
selecting section 153 designates a specific numerical 
value item, of the image information in the classified 
data set, from which graph information is to be 
created, and a specific graph to be created. 

in this embodiment, the graph processing section 
154 processes one of a histogram, one-dimensional 
scatter diagram, two-dimensional scatter diagram, case 
count bar graph, and average value bar graph. The form 
of each graph display will be described later. 

The item selecting section 153 sets classification 
information to be used by the classified data set 
creating section 156 by operation with respect to the 
item selection window shown in FIG. 41, and outputs the 
information to the classified data set creating section 
156. The item selecting section 153 also designates a 
statistical processing type to be processed with 
respect to the statistical processing section 155. The 
item selecting section 153 designates a graph type to 
be processed with respect to the graph processing 
section 154. m addition, the item selecting section 
153 designates, with respect to the statistical 
processing section 155 and graph processing section 
154, an accompanying data item in image information 
which is to be processed. 

FIG. 41 shows the operation window displayed by 
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the item selecting section 153. 

The item selecting section 153 reads out item 
management information and auxiliary information stored 
in the image information holding means 151 through the 
5 storage means management section #123. 

In a graph type selection area 157, the item 
selecting section 153 displays a list of graph types 
which can be created by the graph processing section 
154, and selects one of the graph types from the 
10 contents of the auxiliary information. 

In a classification item selection area 158, the 
item selecting section 153 displays a list of items 
included in the classification key items of the 
accompanying data, and selects one or a plurality of 
15 types of classification items used for the classifica- 

tion of image information from the contents of the item 
management information . 

In a data value 1 selection area 166, the item 
selecting section 153 displays a list of item names 
20 included in the numerical value items of the accom- 

panying data, and selects one of data types used for 
graph creation, statistic calculation, or a statistical 
test from the contents of the item management 
information. 

25 Likewise, in a data value 2 selection area 161, 

the item selecting section 153 displays a list of 
items included in the numerical value items of the 



accompanying data and selects one of data types to be 
used for graph creation, statistic calculation, or a 
statistical test* 

The item selecting section 153 validates or 
invalidates the selection in the data value 1 selection 
area 166 and data value 2 selection area 161 in 
accordance with the selection of a graph type in the 
graph type selection area 157. FIG. 41 shows that the 
selection in the data value 2 selection area 161 is 
invalid. Data value 2 is not required for a histogram, 
one-dimensional scatter diagram, and average value bar 
graph. If, therefore, a histogram and one-dimensional 
scatter diagram are selected in the graph type 
selection area 157, the item selecting section 153 
invalidates the selection in the data value 2 selection 
area 161. In addition, data value 1 and data value 2 
are not required for a case count bar graph. If, 
therefore, a case count bar graph is selected in the 
graph type selection area 157, the item selecting 
section 153 invalidates the selection in the data value 
1 selection area 166 and data value 2 selection 
area 161. 

In a classified data set selection area 162, 
the item selecting section 153 displays a list of 
combinations of item names in accordance with the 
selection items in the classification item selection 
area 158 from the contents of the item management 
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information, and selects one or a plurality of 
combinations. FIG. 41 shows an example in which a list 
of combinations of diagnosis names and patient sexes is 
created from diagnosis names and patient sexes as items 
5 selected in the classification item selection area 158. 

A superimposed information selection area 159 is 
used to select, from the contents of the accompanying 
information, one or a plurality of a statistic 
and statistical test result in the statistical 
10 processing section 155 which are to be superimposed on 

a graph. 

FIGS. 42, 43, 44, 45, and 46 are flowcharts for 
explaining a series of operations accompanying creation 
of graph information in this embodiment. Assume that 

15 graph information is created and displayed on the 

display means #18 in response to the operation of a 
mouse #23 as a trigger. 

This operation will be descried first with 
reference to FIG. 43. FIG. 43 shows a flowchart in 

20 which a classified data set is created from the image 

information held in the image information holding means 
151 in accordance with the classification information 
created by the item selecting section 153, and the data 
set is held. 

25 In step TB-1, the item selecting section 153 sets 

classification information to be used in the classified 
data set creating section 156 and instruction 
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information for a graph processing section T154 and the 
statistical processing section 155. 

The flow of operation in the item selecting 
section 153 will be described with reference to 
5 FIGS. 42 and 44. 

In step TA-1, it is checked whether a cancel 
button 164 is pressed. If the cancel button 164 is 
pressed, the subsequent processing is interrupted. 

It is checked in step TA-2 whether an OK button 

10 163 is pressed. 

If the OK button 163 is pressed, the item 
selecting section 153 designates a selected graph type 
in the graph type selection area 157 with respect to 
the graph processing section 154. The item selecting 

15 section 153 also designates selected statistical 

processing in the superimposed information selection 
are 159 with respect to the statistical processing 
section 155. In addition, the item selecting section 
153 designates, with respect to the graph processing 

20 section 154 and statistical processing section 155, the 

selection in the data value 1 selection area 166 and 
the selection in the data value 2 selection area 161. 
Note that this designation is done only when the data 
value 1 selection area 166 or data value 2 selection 

25 area 161 is valid. The item selecting section 153 

outputs classification information constituted by a 
selected combination in the classified data set 



selection area 162 to the classified data set creating 
section 156. 

After the above processing, the flow returns to 
step TB-1 which is the call source. 

In step TA-3, it is checked whether item selection 
operation is performed. If YES in step TA-3, it is 
checked in steps TA-4 and TA-5 for which selection area 
the operation has been done. 

If the item selection operation has been done in 
the graph type selection area 157, the selected graph 
type is determined in steps TA-7 and TA-9. If the 
selected graph type is a case count bar graph, the data 
value 1 selection area 166 and data value 2 selection 
area 161 are invalidated in step TA-10. If the 
selected graph type is a two-dimensional scatter 
diagram, the data value 1 selection area 166 and data 
value 2 selection area 161 are validated in step TA-8. 
If the selected graph type is other than a case count 
bar graph and two-dimensional scatter diagram, the data 
value 1 selection area 166 is validated and the data 
value 2 selection area 161 is invalidated in step 
TA-11. 

If item selection operation is done in the 
classification item selection area 158, a combination 
of item values that selected one or a plurality of 
classification items can take is created, and the 
display on the classified data set selection area 162 
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is updated in step TA-6. 

In step TB-2, the classified data set creating 
section 156 acquires image information held in the 
image information holding means 151 one by one through 
5 the storage means management section #123. In step 

TB-3, the accompanying data of the acquired image 
information is compared with the classification 
information created by the item selecting section 153 
to check whether the contents of the accompanying data 

10 coincide with the item value combination selected by 

the item selecting section 153. If they coincide with 
each other, the image information is registered and 
held as a data set corresponding to the item value 
combination in step TB-4. The flow then returns to 

15 step TB-2. If they do not coincide with each other, 

the flow returns to step TB-2. 

If all the image information held in the image 
information holding means 151 is completely acquired in 
step TB-2, the flow advances to "C" in FIG. 44. 

20 FIG. 44 shows the flow in which the graph 

processing section 154 creates graph information in 
accordance with a classified data set. 

In step TC-1, the necessity to create 
superimposition information is determined on the basis 

25 of information indicating execution/non-execution of 

selection statistical processing by the superimposed 
information selection window 159 which is contained in 
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25 



the classification information created by the item 
selecting section 153. if the superimposed information 
selection window 159 is to execute selection 
statistical processing, the flow advances to step TC-2 . 
Otherwise, the flow advances to step TC-5. 

In step TC-2, the statistical processing section 
155 determines the type of statistical processing to be 
executed. if the type is a statistic, the flow 
advances to step TC-3. if the type is a statistical 
test, the flow advances to step TC-4. 

Step TC-3 is an execution step for statistic 
calculation processing, in which operation is performed 
in accordance with the processing flow shown in 
FIG. 45. 

In step TD-1 in FIG. 45, statistics associated 
with the numerical value items designated by the item 
selecting section 153 are calculated and held for the 
respective classified data sets held by the classified 
data set creating section 156. 

Step TC-4 is an execution step for statistical 
test processing, in which operation is performed in 
accordance with the processing flow in FIG. 46. 

In step TE-1 in FIG. 46, it is checked whether 
there are two or more classified data sets. If YES in 
step TE-1, it indicates that a test can be performed, 
and the flow advances to step TE-2. If NO in step 
TE-1, the flow returns to step TC-4 in FIG. 44. 
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In step TE-2, a statistic corresponding to the 
type of statistical test is calculated. In this 
embodiment, a t statistic for the execution of a t test 
or a % 2 statistic for the execution of a % 2 test is 
5 calculated- Each statistic is calculated with respect 

to a combination of two classified data sets selected 
from the classified data sets without redundancy. 

The t test is used to test the presence/absence of 
the difference in the average value of numerical value 
10 items between two classified data sets. The % 2 test 

is used to test the independency of classification key 
items between two classified data sets. 

For example, in the t test, a Student's t 
statistic 



15 



A + i> 

where X and Y are sample means, and m and n are sample 
counts is calculated. 



m n 



X (Xi - X)2 + £ ( Yj - Y)2 



20 In addition, s = - — 3 — ± s 

m + n - 2 

calculated from the classified data sets held in the 
classified data set creating section 156. 

In calculating a % 2 statistic in this embodiment, 
with respect to the combination of classification key 
25 item values which is selected by the item selecting 

section 153, a contingency table is created by using 
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the classification key located at the head as an 
attribute for contingency table creation (in the case 
shown in FIG . 41, a diagnosis of adenocarcinoma/stomach 
cancer is used as an attribute for contingency table 
creation) , and 



is calculated by using the accumulated value of the 
contingency table. 

A detailed description of each statistic will be 
omitted. 

In step TE-3, by using the statistics calculated 
in step TE-2, hypothesis test concerning p < 0.05, p < 
0.01, and p < 0.001 is executed with respect to each 
combination of two classified data sets selected from 
the classified data sets without redundancy. 

If the test result on p < 0.05 is rejected, NS is 
held as a test result. 

If the test result on p < 0.05 is accepted, and 
the test result on p < 0.01 is rejected, p < 0.05 is 
held as a test result. 

Subsequently, in the same manner, in accordance 
with the test results, p < 0.01 or p < 0.001 is held as 
a test result. 

In step TC-5, a graph of the graph type designated 
by the item selecting section 153 is increased, in 
which data are grouped for each classified data set. 




i j 



In step TC-6, the necessity for superimposition 
information creation is determined. If designation 
information from the item selecting section 153 
includes selection of statistical processing in the 
superimposed information selection window 159, and the 
flow advances to step TE-2 upon determination in step 
TE-1 in FIG. 46, the flow advances to step TC-7. 
Otherwise, the graph information created in step TC-5 
is displayed on the display means #18, and the 
processing is terminated. The graph information 
displayed in step TC-5 includes no information to be 
superimposed. 

In step TC-7, statistically processed information 
is superimposed on the graph information created in 
step TC-5 on the basis of the information created in 
step TD-1 in FIG. 45 or step TE-3 in FIG. 46, and the 
resultant information is displayed on the display means 
#18. The processing is then terminated. 

FIGS. 47, 48, 49, and 50 respectively show display 
examples of graphs according to this embodiment. 
FIG. 47 shows an example of a one-dimensional scatter 
diagram, in which the position of average value of 
characteristic value 1 ± standard deviation is 
indicated by line rendering. FIG. 48 shows an example 
of a histogram, in which the position of the average 
value of characteristic value 1 is indicated by line 
rendering. FIG. 4 9 shows an example of superimposing t 
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test results on an average value bar graph, in which 
the results obtained by executing a t test of 
characteristic value 1 with respect to each of three 
items are plotted. FIG. 50 shows an example of 
5 superimposing %2 test results on a case count bar 

graph, in which the case count bar graph and the 
test results obtained when HP+ and HP- are set as 
attributes of a contingency table are plotted on the 
basis of four combinations of HP+/atrophy degree (+), 

10 HP+/atrophy degree (-), HP-/atrophy degree (+) , and 

HP-/atrophy degree (-) . 

In this embodiment, graph information grouped for 
each classified data set is created, and statistical 
information for each classified data set is 

15 superimposed/displayed on the graph information. 

However, the processing result obtained by the 
statistical processing section 155 may be displayed on 
the display means #18 to display, for each classified 
data set, a statistic or statistical test result 

20 concerning the accompanying data item selected by the 

item selecting section 153, as shown in FIG. 51. 
(Effects) 

Displaying statistically processed information on 
a graph allows easy comparison with the statistically 
25 processed information and provides objective 

understanding of the graph display owing to the 
statistically processed information. 
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In creating a graph, classification items and data 
values are separately displayed and selected. This 
prevents the operator from mistakenly selecting a 
classification item as a data value or mistakenly 
5 selecting a data value as a classification item, and 

improves operability . 

Since a combination of a plurality of selected 
classification items is used as a classification item, 
the labor spent to create a graph is reduced. 
10 Since only items selected from a combination of a 

plurality of selected classification items are used as 
classification items, the labor spent to create a graph 
is reduced. 

A modification of the third embodiment will be 
15 described next. 

This modification differs from the third 
embodiment in that the item selecting section 153 
displays an operation window having a check box 165, as 
shown in FIG. 52. FIG. 44 showing the processing flow 
20 in the third embodiment is revised into FIG. 53. The 

difference between FIGS. 53 and 44 is that steps TC-8 
and TC-9 are inserted in FIG. 53. 

The item selecting section 153 transfers the 
checked state of the check box 165 in FIG. 52 as 
25 designation information to the graph processing 

section 154. 

In step TC-8 in the processing flow shown in 
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FIG. 53, the graph processing section 154 checks from 
the designation information from the item selecting 
section 153 whether the check box 165 is checked. If 
the check box is not checked, one piece of graph 
5 information is created by grouping image information of 

each classified date set in step TC-5 in the same 
manner as in the third embodiment. 

If the check box 165 is checked, pieces of graph 
information equal in number to classified data sets are 

10 created in step TC-9. In addition, if the check box 

165 is checked, statistic information for each 
classified date set is superimposed on corresponding 
graph information in step C-7. 

FIGS. 54A and 54B show the content to be displayed 

15 when the check box 165 is checked in operation for the 

graph information display shown in FIG. 47. As shown 
in FIGS. 54A and 54B, a graph is displayed for each 
classified data set. This reduces the labor spent to 
repeatedly create graphs for the respective classified 

20 data sets. In addition, the axial scale of each 

classified date set is increased to make it easier to 
read the value of each item from the graph. Further- 
more, this reduces the overlap between the respective 
graph elements to prevent misidentif ication of the 

25 frequency distributions of graph elements. 

Assume that in step TC-9, when the check box 165 
is checked, graph information is created for each of a 
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combination of two classified data sets selected from 
the classified data sets without redundancy. In this 
case, as shown in FIGS. 55A to 55C, graphs equal in 
number to the number of times a statistical test is 
5 executed are displayed, and hence the resultant display 

is easier to read than the display in FIG. 49. 
[Fourth Embodiment] 

The fourth embodiment of the present invention 
will be described with reference to the several views 
10 of the accompanying rendering. The fourth embodiment 

is the same as the third embodiment except that the 
arrangement of a diagnostic support content creating 
section #127 is different from that in third 
embodiment . 

15 FIG. 56 is a block diagram of a main program #121, 

which shows the arrangement of the diagnostic support 
content creating section #127 according to the fourth 
embodiment of the present invention. The difference 
between this embodiment and the third embodiment will 

20 be described below. 

The diagnostic support content creating section 
#127 includes an information list creating section 171, 
graph creating section 154, and display information 
management section 172. 

25 The information list creating section 171 displays 

a list of image information acquired from a storage 
means management section #123 as an image information 
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list 173 shown in FIG. 58 on a display means #18. 

The image information list 173 includes an image 
data display area 174 and accompanying data display 
area 175. 

5 In the image data display area 174, the image data 

of the image information acquired from the storage 
means management section #123 is displayed as an image 
list. 

In the accompanying data display area 175, the 

10 accompanying data of the image information acquired 

from the storage means management section #123 is 
displayed as a list. 

The graph creating section 154 is similar to the 
graph creating section in the third embodiment, and 

15 displays, for example, graph information 160 shown in 

FIG. 59 on the display means #18. 

The display information management section 172 
holds the correspondence between image information and 
each image displayed in the image data display area 

20 174, the correspondence between image information and 

each line of a list displayed in the accompanying data 
display area 175, and the correspondence between image 
information and each graph element displayed on the 
graph information 160. 

25 The display information management section 172 

detects the operation of a mouse cursor 176 by a mouse 
#23, and acquires the operation information of the 
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mouse cursor 17 6 through the input I/F #58. 

When an image in the image data display area 174 
is selected by the operation of the mouse cursor 176, 
the display information management section 172 acquires 
image information corresponding to the selected image 
from the correspondence between the image imaging and 
each image display in the image data display area 174. 

When a line in the image data display area 174 is 
selected by the operation of the mouse cursor 176, the 
display information management section 172 acquires 
image information corresponding to the selected line 
from the correspondence between the image information 
and each line displayed in the image data display 
area 174. 

When a graph element on the graph information 160 
is selected by the operation of the mouse cursor 176, 
the display information management section 172 acquires 
image information corresponding to the selected graph 
element from the correspondence between the image 
information and each graph element displayed on the 
graph information 160. 

The display information management section 172 
selects an image in the image data display area 174 
displayed on the display means #18, and inverts the 
color tone of the display. The display information 
management section 172 selects a line in the 
accompanying data display area 175 displayed on the 
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display means #18, and inverts the color tone of the 
display. The display information management section 
172 selects an image on the graph information 160 
displayed on the display means #18, and changes the 
5 color tone of the display. In this embodiment, an 

image whose color tone is inverted or not inverted is 
displayed in the image data display area 174, a line 
whose color tone is inverted or not inverted is 
displayed in the accompanying data display area 175, 

10 and a black or red graph element is displayed on the 

graph information 160. 

FIG. 57 is a flowchart for the display information 
management section 172, which explains linking 
operation between the image information list 173 and 

15 the graph information 160 in this embodiment. Assume 

that the image information list 173 and graph 
information have already been displayed on the display 
means #18. 

In step TH-1, the display information management 
20 section 172 detects that an image in the image data 

display area 174, a line in the accompanying data 
display area 175, or a graph element on the graph 
information 160 is selected with the mouse cursor 176, 
and acquires the operation information of the mouse 
25 cursor 176. 

In step TH-2, all images to be displayed in the 
image data display area 174 are displayed as images 
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whose color tones are not inverted. 

Alternatively, in step TH-2, all lines to be 
displayed in the accompanying data display area 175 are 
displayed as lines whose color tones are not inverted. 

Alternatively, all graph elements to be displayed 
on the graph information 160 are displayed as black 
graph elements. 

In step TH-3, the display information management 
section 172 acquires image information from the image, 
line, or graph element, selected by the selecting 
operation in step TH-1, using the correspondence 
between image information and each image displayed in 
the image data display area 174, the correspondence 
between image information and each line displayed in 
the accompanying data display area 174, and the 
correspondence between image information and each graph 
element displayed on the graph information 160. 

In step TH-4, the display information management 
section 172 acquires an image in the image data display 
area 174, a line in the accompanying data display area 
175, and a graph element in the graph information 160, 
which correspond to the image information acquired in 
step TH-3, by using the correspondence between the 
image information and each image displayed in the image 
data display area 174, the correspondence between the 
image information and each line displayed in the 
accompanying data display area 175, and the 
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correspondence between the image information and each 
graph element displayed on the graph information 160. 

In step TH-5, the image in the image data display 
area 174, the line in the accompanying data display 
5 area 17 5, and the graph element on the graph 

information 160, which are acquired in step TH-4, 
are displayed on the display means #18 as a 
color-tone-inverted image, color-tone-inverted line, 
and a red graph element, respectively. 

10 FIGS. 58 and 59 show how a graph element is 

displayed as a red graph element upon selection of 
the graph element with the mouse cursor 17 6, and an 
image and line corresponding to image information 
corresponding to the graph element are inverted/ 

15 displayed. 

When graph elements on the graph information 160 
are enclosed with a rectangle by the operation of the 
mouse cursor 17 6 as shown in FIG. 60, processing from 
step TH-3 to step TH-5 is executed with respect to all 

20 the graph elements enclosed within the rectangle to 

display all the graph elements included in the 
rectangle as red elements and invert/display images 
corresponding to image information corresponding to the 
graph elements. 

25 Note that as methods of changing the display of 

graph elements by selection include, for example, 
methods of changing the shapes and sizes and enclosing 



96 - 



the graph elements within circular and rectangular 
markers as well as the method of changing the color 
tone as in this embodiment are available. Methods of 
changing the display of images include methods of 
5 changing the contrast and size and adding makers. 

Methods of changing the display of lines include 
methods of changing the display character color, 
display character thickness, and display character font 
and adding markers. 

10 (Effect) 

Images, accompanying data, and graph elements 
can be referred to in association with each other, 
resulting in improved operability. 
[Fifth Embodiment] 

15 The fifth embodiment of the present invention will 

be described with reference to the several views of the 
accompanying rendering. The fifth embodiment is the 
same as the fourth embodiment except that the 
arrangement of a diagnostic support content creating 

20 section #127 is different from that in the fourth 

embodiment . 

FIG. 62 is a block diagram of a main program #121, 
which shows the arrangement of the diagnostic support 
content creating section #127 according to the fourth 
25 embodiment of the present invention. The difference 

between this embodiment and the fourth embodiment will 
be described below. 
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Unlike the diagnostic support content creating 
section #127 in the fourth embodiment, the diagnostic 
support content creating section #127 in this embodi- 
ment includes an information setting section 181. 

A display information management section 172 
displays a menu 190 shown in FIG- 63 at the display 
position of a mouse cursor 176 upon selection of an 
image in an image data display area 174, a line in 
accompanying data display area 174, or a graph element 
on graph information 160 by the operation of the mouse 
cursor 176. The menu 190 includes a selected element 
information updating 191 and selected element 
region-of-interest setting 192. When the selected 
element information updating 191 is selected, the 
display information management section 172 acquires 
image information corresponding to the selection of the 
image in the image data display area 174, the line in 
the accompanying data display area 175, or the graph 
element on the graph information 160 with the mouse 
cursor 17 6, and outputs the acquired information to the 
information setting section 181. 

The display information management section 172 
causes an information list creating section 171 and 
graph creating section 154 to re-create an image 
information list 173 and the graph information 160 in 
accordance with instructions to re-create the image 
information list 173 and graph information 160 from 
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the information setting section 181, and updates the 
display on a display means #18. 

Assume that the graph creating section 154 in this 
embodiment determines whether to use image information 
5 for graph creation, in accordance with the contents of 

graph creation attributes contained in the accompanying 
data of the image information. 

The information setting section 181 sets 
accompanying data for the image information transferred 
10 from the information setting section 181, and updates 

the image information held in an image information 
holding means 151. The information setting section 181 
also issues, to the display information management 
section 172, instructions to re-create the image 
15 information list 173 and graph information 160. 

The information setting section 181 includes an 
item value setting section 183 and information updating 
section 182 . 

The information updating section 182 updates the 
20 image information held in the image information holding 

means 151 by transferring the image information for 
which the accompanying data is set by the item value 
setting section 183 to a storage means management 
section #123, and also updates the display contents of 
25 the accompanying data display area 175 on the image 

information list 173 and the display contents of 
the graph information 160 by issuing re-creating 
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instructions to the display information management 
section 172. 

The item value setting section 183 sets 
accompanying data for the image information. 
5 FIG. 64 shows a setting operation window for 

accompanying data for image information, which is 
operated by the item value setting section 183. The 
setting operation window is formed from an information 
update window 184. The information update window 184 
10 includes a change item selection area 185, change item 

value selection area 186, image data display area 187, 
and update button 18 8. 

The items displayed in the change item selection 
area 185 and change item value selection area 186 are 
15 selected one by one. 

In the image data display area 187, the image data 
of set image information is displayed. 

The item value setting section 183 acquires item 
management information held in the image information 
20 holding means 151, acquires all pieces of item name 

information of the items, of the item management 
information, which are classified to the classified 
key item, and stores them in the change item selection 
area 185. 

25 The item value setting section 183 also acquires 

item value information corresponding to the items 
selected by the change item selection area 185 from 
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the item management information held in the image 
information holding means 151 through the storage means 
management section #123. 

When the update button 188 is clicked with a mouse 
5 #23, an item to be changed and item value with respect 

to the accompanying data of the image information are 
transferred to the information updating section 182. 

FIG. 61 is a flowchart for the display information 
management section 172 and information setting section 

10 181, which explains operation of changing the display 

of the image information list 173 and graph information 
160 accompanying a change of the settings of image 
information. FIG. 61 is a flowchart showing processing 
after the image information list 173 and graph infor- 

15 mation are displayed on the display means #18 and the 

selected element information updating 191 is selected 
from the menu 190 by the operation of the mouse #23. 

Steps TJ-1, TJ-2, and TJ-5 are processing steps in 
the display information management section 172. 

20 Steps TJ-3 and TJ-4 are processing steps in the 

information setting section 181. 

In step TJ-1, the display information management 
section 172 detects the selection of an image in the 
image data display area 174, a line in the image data 

25 display area 174, or a graph element on the graph 

information 160 with the mouse cursor 17 6, and acquires 
operation information . 
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In step TJ-2, the display information management 
section 172 acquires image information from the image/ 
line, or graph element, selected by the selecting 
operation in step TH-1, using the correspondence 
between image information and each image displayed in 
the image data display area 174, the correspondence 
between image information and each line displayed in 
the accompanying data display area 174, and the 
correspondence between image information and each graph 
element displayed on the graph information 160. 

In step TJ-3, the image information acquired in 
step TJ-2 is set by the item value setting section 183. 
The image data of the image information is displayed in 
the image data display area 187 in the information 
update window 184 shown in FIG. 64. When an item in 
the change item selection area is selected with the 
mouse #23, item contents corresponding to the selected 
item are displayed in the change item value selection 
area 186. Of the contents displayed in the change item 
value selection area 186, the contents set in the 
accompanying data of the image information are 
inverted/displayed. When an item in the change item 
value selection area is selected with the mouse #23, 
the item inverted before the selection is restored, and 
the selected item is inverted/displayed. 

When the update button 188 is clicked with the 
mouse #23, the item value setting section 183 acquires 
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the selected item in the change item selection area 185 
and the selected item value in the change item value 
selection area 186. 

In step TJ-4, the information updating section 182 
5 transfers the image information set by the item value 

setting section 183 to the storage means management 
section #123 to hold, in the image information holding 
means 151, the image information whose settings have 
been changed . 

10 In step TJ-5, the item value setting section 183 

instructs the display information management section 
172 to re-create the image information list 173 and 
graph information 160. The display information 
management section 172 instructs the information list 

15 creating section 171 and graph creating section 154 to 

re-create the image information list 173 and graph 
information 160. 

The graph creating section 154 determines, in 
accordance with the contents of a graph creation 

2 0 attribute as an accompanying data item in image 

information, whether to use the image information to 
graph creation. Therefore, the graph creating section 
154 makes a setting to display/non-display elements on 
the graph information 160, in accordance with the graph 

25 creation attribute settings in the item value setting 

section 183. 

In this embodiment, the image data of image 
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information is displayed in the image data display area 
187 in the information update window 184. In this 
case, the image data to be displayed may be reduced to 
reduce the size of the information update window 184 as 
5 to allow the operator to see the display of the image 

data display area 17 4 and make accompanying data 
settings while referring to the accompanying data of 
other image information. 
(Effects) 

10 Since a graph element is selected on the graph 

information 160 and image information is set for the 
selected graph element, operability is improved. 

In addition, since whether or not to display a 
graph element is selected by operation on the graph 

15 information 160, unnecessary graph elements can be 

easily removed from the graph information 160. 

Furthermore, in setting image information, image 
data is displayed. Therefore, when a plurality of 
graph elements are selected and pieces of image 

20 information are consecutively set, the operator can 

know the contents of image data. This prevents error 
settings in image information. 

A modification of the fifth embodiment will be 
described next. 

25 This modification will be described with reference 

to FIG. 67 and FIGS. 40A to 40C. 

In the item management information, contents 
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corresponding to hierarchical information shown in 
FIG. 67 are stored as the item name information of 
arbitrary set character string items 1 to Q and the 
item value information of the arbitrary set character 
string items 1 to Q. In addition, in the item 
management information, the item values (not shown) of 
at higher hierarchical levels of items and pieces of 
information (not shown) at item hierarchical levels 
which respectively correspond to the arbitrary set 
character string items 1 to Q are stored. 

For example, information contents an occupying 
lesion of the stomach is stored such that the item name 
of arbitrary set character string item 1 is set to 
occupying lesion of stomach; the item value information 
of arbitrary set character string item 1, to cardia, 
curvature ventriculi minor, the item value of the 

higher hierarchical level of arbitrary set character 
string item 1, to stomach; and the item hierarchical 
level, to 1. In another example, likewise, the item 
name of arbitrary set character string item 2 is set to 
early cancer macroscopic classification; the item value 
information of arbitrary set character string item 2, 
to I type, Ila type, ...; the item value of the higher 
hierarchical level of arbitrary set character string 
item 2, to cancer; and the item hierarchical level, 
to 4. 

Item hierarchical levels are set such that 1 
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corresponds to an occupying lesion position; 3, the 
position of fine classification 1; 4, the position of 
fine classification 2; 5, the position of fine 
classification 3; and 6, the position of fine 
5 classification 4. 

This modification will be described next with 
reference to FIG. 65. 

FIG. 65 shows a setting operation window for the 
accompanying data of image information, which is 

10 operated by the item value setting section 183. The 

setting operation window is formed from the information 
update window 184. The information update window 184 
includes a patient name input item 220, an examination 
date input item 221, an examination region input item 

15 222, an occupying region input item 223, a diagnosis 

name input item 224, a fine classification 1 input item 
225, a fine classification 2 input item 226, a fine 
classification 3 input item 227, a fine classification 
4 input item 228, an update button 229, a fine 

20 classification 1 item name field 231, a fine 

classification 2 item name field 232, a fine 
classification 3 item name field 233, and a fine 
classification 4 item name field 234. 

When item value setting section 183 starts 

25 processing, the item value setting section 183 acquires 

item management information held in the image infor- 
mation holding means 151 through the storage means 
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management section #123, and creates the hierarchical 
information shown in FIG. 67 from the item value 
information of an examination region, the item value 
information of a diagnosis, the item name information 
5 of arbitrary set character string items 1 to Q, and the 

item value information of arbitrary set character 
string items 1 to Q. 

When the button on the side of the diagnosis name 
input item 224 is clicked with the mouse #23, the item 

10 value setting section 183 uses the hierarchical infor- 

mation to store and display the item values of the 
corresponding items in a menu 230, as shown in FIG. 66, 
and selects the contents of the diagnosis name input 
item 224 from the menu 230. 

15 Referring to FIG. 66, when, for example, the 

button on the side of the diagnosis name input item 224 
is clicked, stomach as the information stored in the 
examination region input item is acquired, and a 
diagnosis name whose upper item is stomach is acquired 

20 from the hierarchical information and stored in the 

menu 230. 

Similar processing is performed with respect to 
the examination region input item 222, occupying region 
input item 223, fine classification 1 input item 225, 
25 fine classification 2 input item 226, fine classifica- 

tion 3 input item 224, and fine classification 4 input 
item 226. 
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In addition, the item value setting section 183 
displays item names in the fine classification 1 item 
name field 231, fine classification 2 item name field 
232, fine classification 3 item name field 233, and 
fine classification 4 item name field 234 by using the 
hierarchical information in accordance with the input 
item name of the diagnosis name. 

Referring to FIG- 68, when, for example, cancer is 
selected as a diagnosis name, Borrman classification, 
early stomach cancer macroscopic classification, and 
progression degree, which are item names located at 
lower hierarchical levels with respect to stomach as an 
examination lesion and cancer as a diagnosis name, are 
selected from the hierarchical information and 
displayed in the fine classification 1 item name field 
231, fine classification 2 item name field 232, and 
fine classification 3 item name field 233, respec- 
tively- Assume that the display contents of the 
fine classification 1 item name field 231, fine 
classification 2 item name field 232, and fine 
classification 3 item name field 233 are names 
contained in the hierarchical information. In this 
case, when the button on the right side of each input 
item is clicked, the item value of the corresponding 
item is stored and displayed in the menu 230, as in 
the case of the diagnosis name input item 224, and the 
item content of each input item is selected from the 
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menu 230. 
(Effects) 

A menu of a list of choices to be input is created 
and displayed in accordance with hierarchical infor- 
5 mation and the contents set in higher hierarchical 

levels. This prevents the operator from erroneously 
inputting information to a choice that cannot be 
selected. In addition, since no choice that cannot be 
selected is displayed, the display becomes readable, 

10 and the operability is improved. 

Furthermore, in accordance with the contents set 
at higher hierarchical levels, the names of items to be 
input are updated/displayed, and items to be input are 
set. This prevents the operator to erroneously input 

15 information to items that cannot be selected. In 

addition, since unnecessary display in the window is 
omitted, the operability is improved. 
[Sixth Embodiment] 

The sixth embodiment of the present invention will 

20 be described with reference to the several views of the 

accompanying rendering. The sixth embodiment is the 
same as the fourth embodiment except that the 
arrangement of a diagnostic support content creating 
section #127 is different from that in the fourth 

2 5 embodiment . 

FIG. 69 is a block diagram of a main program #121, 
which shows the arrangement of the diagnostic support 
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content creating section #127 according to the sixth 
embodiment of the present invention. The difference 
between the sixth and fifth embodiments will be 
described below. 
5 Unlike the diagnostic support content creating 

section #127 in the fifth embodiment, the diagnostic 
support content creating section #127 in the sixth 
embodiment has a region-of-interest setting section 201 
in place of the item value setting section 183. 

10 In this embodiment, an information list creating 

section 171 renders a region of interest on an image 
contained in an image data display area 174 of an image 
information list 173 on the basis of the image data of 
image information and region-of-interest data. FIG. 71 

15 shows display of the image information list 173 in this 

embodiment . 

The region-of-interest setting section 201 sets 
region-of-interest data corresponding to the image data 
with respect to the image information acquired from a 

20 display information management section 172 by operating 

a mouse #23 in the image data display area 174 of the 
image information list 173. 

The image information containing the set 
region-of-interest data is held in an image information 

25 holding means 151 through an information updating 

section 182. In addition, display of the image data 
and region-of-interest data stored in the image data 
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display area 174 is updated through the information 
updating section 182. 

The display information management section 172 
displays a menu 190 shown in FIG- 63 at the display 
position of a mouse cursor 176 upon selection of an 
image in the image data display area 174, a line in the 
accompanying data display area 174, and a graph element 
on graph information 160 by the operation of the mouse 
cursor 176. The menu 190 includes selected element 
information updating 191 and selected element 
region-of-interest setting 192. 

When the selected element region-of-interest 
setting 192 is selected, the display information 
management section 172 acquires image information 
corresponding to the selection of an image in the image 
data display area 17 4, a line in the accompanying data 
display area 175, or a graph element on the graph 
information 160 with the mouse cursor 176, and outputs 
the information to an information setting section 181. 

A region of interest is set by operating the mouse 
#23. As shown in FIG. 72A, the mouse #23 has a left 
button 202 and right button 203. 

Assume that in this embodiment, a region of 
interest is rectangular. 

FIG. 70 is a flowchart for the region-of-interest 
setting section 201, which explains how a region of 
interest is set in this embodiment. The following 
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description is based on the assumption that a region of 
interest is set on an image in the image data display 
area 174 of the image information list 173, and the 
selected element information updating 191 has been 
5 selected from the menu 190 by the operation of the 

mouse #23. 

This embodiment will be descried with reference to 
FIGS. 72A, 72B, and 72C. 

FIG. 72A shows the operation of the mouse 23 in a 
10 moving step (TI-2) and display on an image. 

FIG. 72B shows the operation of the mouse 23 in a 
size changing step (TI-4) and display on an image. 

FIG. 72C shows the operation of the mouse 23 in a 
position temporarily determining step (TI-3) and 
15 display on an image. 

In addition to a region 206 of interest set on 
image information, a temporary region 204 of interest 
which is a temporary region of interest set on the 
image information, and an in-process region 205 of 
20 interest which is a region of interest which is being 

set by the operation of the mouse #23 are rendered/ 
displayed on the image on which a region of interest is 
to be set. 

On each of the images shown in FIGS. 72A, 72B, and 
25 72C, the hatched closed area indicates the region 206 

of interest set on the image information, the solid 
outlined closed area indicates the temporary region 204 
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of interest, and the dotted outlined closed area 
indicates the region 205 of interest that is being set 
by the operation of the mouse #23. 

When the region-of-interest setting section 201 
5 starts processing, the flow advances to the moving step 

(TI-2) . 

In the moving step (TI-2) , the in-process region 
205 of interest is moved/displayed in accordance with 
the movement of the mouse 23. When the operator moves 

10 the mouse 23 without pressing the left button 202 and 

right button 203 as shown in FIG. 72A, the in-process 
region 205 of interest moves in accordance with the 
movement of the mouse 23. 

If the left button 202 is pressed in the moving 

15 step (TI-2) , the flow advances to the position 

temporarily determining step (TI-3) . 

In the position temporarily determining step 
(TI-3) , when the temporary region 204 of interest is 
erased and the right button 203 is released, the 

20 position and size of the in-process region 205 of 

interest are set to the position and size of the 
temporary region 204 of interest. 

In the position temporarily determining step 
(TI-3) , when the mouse #23 is moved while the right 

25 button 203 is pressed, the flow advances to the size 

changing step (TI-4) . In the size changing step 
(TI-4) , the upper left coordinates of the in-process 



region 205 of interest are fixed as an origin, and the 
size of the rectangle is changed in accordance with the 
movement of the mouse #23 with the left button 202 is 
being pressed. 

When the left button 202 is pressed, the flow 
advances from the moving step (TI-2) to the position 
temporarily determining step (TI-3) to set/change the 
temporary region 204 of interest. The mouse #23 is 
then moved to cause the flow to advance to the size 
changing step (TI-4), in which the size of the 
in-process region 205 of interest is changed in 
accordance with the movement of the mouse #23 while 
the upper left coordinates of the rectangle of the 
in-process region 205 of interest are fixed. 

In the size changing step (TI-4), when the left 
button 202 is released, the flow advances to the moving 
step (TI-2) through the position temporarily deter- 
mining step (TI-3) . The position and size of the 
in-process region 205 of interest are set to the 
position and size of the in-process region 205 of 
interest through the position temporarily determining 
step (TI-3) . 

In the moving step (TI-2), when the right button 
203 is pressed, the flow advances to the area setting 
step (TI-1) to set the position and size of the 
temporary region 204 of interest as the region-of- 
interest data of the image information. The processing 



in the region-of-interest setting section 201 is then 
terminated. 

The information updating section 182 holds the 
image information containing the region-of-interest 
data set by the region-of-interest setting section 201 
in the image information holding means 151 through the 
storage means management section #123. in addition, 
the rendered display of the region of interest is 
updated with respect to the image data in an image data 
display area 187 through the display information 
management section 172. 

In this embodiment, a region of interest is 
rectangular. However, it may be elliptic or an 
arbitrary set closed area. The rectangular area in 
this embodiment is replaced with a rectangle or 
arbitrary set closed area enclosing an ellipse, and the 
same operation as described above is performed. In 
this embodiment, in the size changing step (TI-4), the 
size is changed while the upper left coordinates of the 
rectangle are fixed as an origin. However, the size 
may be changed while the center of the rectangle is 
fixed as an origin. 
(Effect) 

A region of interest can be easily set because the 
position and size of the region of interest are set by 
performing region-of-interest setting operation once 
with the mouse #23. 
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[Seventh Embodiment] 

The seventh embodiment of the present invention 
will be described with reference to the several views 
of the accompanying rendering. FIG. 73 is a block 
5 diagram of a main program #121 according to the seventh 

embodiment of the present invention. No unnecessary 
portion is shown in this embodiment. The seventh 
embodiment is the same as the fourth embodiment except 
that a marker rendering section 213 is inserted between 

10 a storage means management section #123 and a 

diagnostic support content creating section #127. 

The difference between the seventh and fourth 
embodiments will be described below. 

The marker rendering section renders a frame 210 

15 shown in FIG. 75A with respect to image data in 

accordance with the information of an item contained in 
the accompanying data of input image information. The 
image information containing the image data on which 
the frame is rendered is output to the diagnostic 

20 support content creating section #127. 

In this embodiment, the frame 210 is rendered in 
accordance with information indicating a patient sex in 
the accompanying data. If the patient sex is male, the 
frame 210 is rendered with respect to the image data. 

25 If the patient sex is female, the frame 210 is not 

rendered. 

FIG. 74 is a flowchart for the marker rendering 
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section 213, which explains how a marker is rendered on 
image data in accordance with an item contained in 
accompanying data in this embodiment. 

In step TF-1, the marker rendering section 213 
5 acquires patient sex information in the accompanying 

data of input image information. 

In step TF-2, if the patient sex information 
acquired in step TF-1 indicates male, the frame 210 is 
rendered as a maker with respect to the image data. If 

10 the patient sex information acquired in step TF-1 

indicates female, no marker is rendered with respect to 
the image data. 

In this embodiment, patient set information in 
accompanying data is used as an determination item for 

15 marker rendering. However, information such as a 

category classification, diagnosis name, examination 
region, or graph display attribute, which is classified 
as a classification key item, may be used as a deter- 
mination item. Alternatively, each item stored in a 

20 numerical value item may be used as a determination 

item to perform determination in accordance with the 
range of values. 

In this embodiment, the presence/absence of a 
rendered frame is used as a marker. However, the color 

25 tone of a frame may be changed in accordance with 

determination on a determination item. Alternatively, 
as shown in FIGS. 75B and 75C, a marker whose shape is 
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changed, e.g., a circular marker 211 or star marker 
212, may be rendered in image data in accordance with 
determination on a determination item. Furthermore, 
the display position of the circular marker 211 may be 
changed in accordance with determination on a 
determination item. 
(Effect) 

Since the contents of accompanying data can be 
known at a glance of a list of image data, operability 
is improved. 
[Eighth Embodiment] 

The eighth embodiment of the present invention 
will be described with reference to the several views 
of the accompanying rendering. FIG. 7 6 is a block 
diagram of a main program #121 according to the eighth 
embodiment of the present invention. No unnecessary 
portion is shown in this embodiment. The eighth 
embodiment is the same as the seventh embodiment except 
that a character information erasing section 240 and 
character information rendering section 241 are 
inserted in place of the marker rendering section 213. 

The difference between the eighth and seventh 
embodiments will be described below. 

The character information erasing section 240 
performs erase processing with respect to an area in 
which patient examination information is rendered, of 
the image data of input image information, and erases 
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the patient examination information rendered on the 
image data. The shape, position, and size of an area 
subject to erase processing are determined in advance. 

The image information containing image data from 
which the patient examination information is erased 
is output to the character information rendering 
section 241. 

The character information rendering section 241 
renders, on the image data, the contents of items 
contained in the accompanying data of the input image 
information. 

Assume that in this embodiment, the values of 
characteristic value 1 and characteristic value 2 in 
the accompanying data are rendered. 

FIG. 77 is a flowchart for processing performed by 
the character information erasing section 240 and 
character information rendering section 241, which 
explains how patient examination information is erased 
from image data and item information contained in the 
accompanying data is rendered on the image data. 

In step TG-1, the character information erasing 
section 240 erases patient examination information from 
the image data of input image information. 

In step TG-2, the character information rendering 
section 241 renders the values of characteristic value 
1 and characteristic value 2 contained in the accom- 
panying data of the input image information on the 



image data having undergone the erase processing in 
step TG-1. The character information rendering section 
241 also renders characteristic value 1 and charac- 
teristic value 2 as character strings representing the 
contents of rendering information above the respective 
values . 

FIG. 78 shows a display example of the image data 
from which the patient examination information rendered 
thereon is erased and on which the values of charac- 
teristic value 1 and characteristic value 2 are 
rendered. 

In this embodiment, characteristic value 1 and 
characteristic value 2 are rendered. However, other 
accompanying data items may be displayed together with 
their item names. 
(Effects) 

Since the patient examination information 
displayed on an image is erased, any leakage of patient 
privacy information can be prevented. In addition, 
since the patient examination information is erased, 
the blank area on the image data expands. The 
character size of character information to be newly 
superimposed/rendered can be increased. This makes the 
superimposed information easy to read and improves 
operability. In addition, since the information amount 
of character information to be superimposed/rendered 
can be increased, the operator can obtain more 
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information by only looking at the image data display, 
resulting in improved operability. 
[Ninth Embodiment] 

The ninth embodiment of the present invention will 
5 be described with reference to the several views of the 

accompanying rendering. FIG. 79 is a block diagram of 
a main program #51 according to the ninth embodiment of 
the present invention. No unnecessary portion is shown 
in this embodiment. The ninth embodiment is the same 

10 as the second embodiment except that an image 

processing section 250 is inserted in a diagnostic 
support content creating section #127. 

The image processing section 250 acquires image 
information through a storage means management section 

15 #123, and calculates an image processing value on 

the basis of the image data contained in the image 
information. The image processing section 250 also 
acquires an image processing table 251 shown in FIG. 81 
from a diagnostic support content management section 

20 #124, and holds it. 

In this embodiment, image data is constituted by 
R, G, and B digital signal per pixel. R, G, and B each 
take a value from 0 to 255. The image processing value 
calculated by the image processing section 220 is set 

25 to an index of hemoglobin for each pixel. 

The image processing section 250 receives the 
pixel data (R, G, B) of the image data, and outputs an 
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image processing value n which is a converted value of 
the pixel data. 

In this embodiment, n represents an index of 
hemoglobin. An index of hemoglobin is a value 
5 calculated from an expression of 321og2 (R/G) using 

pixel data (R, G, B) . This value reflects the 
magnitude of a mucosal blood flow, and is used as one 
of techniques of evaluating a mucosal color tone in the 
endoscopic medical field. 

10 As shown in FIG. 81, the image processing table 

251 has an array of M storage areas each having pixel 
values sequentially arranged on a byte basis from 
(R, G, B) = (0, 0, 0) to (R, G, B) = (255, 255, 255) . 

FIG. 80 is a block diagram showing the details of 

15 the image processing section 250. The image processing 

section 250 includes an image processing table access 
section 252 and conversion table changing section 253. 

The image processing table access section 252 
receives a pixel value (R, G, B) and outputs the 

20 converted value n. The image processing table access 

section 252 holds m (1 ^ m ^ M) , as a set value, 
corresponding to an index of hemoglobin, which is an 
identifier of an image processing type. 

The image processing table access section 252 

25 loads the access position of an image processing table 

on the basis of the input pixel value (R, G, B) and the 
image processing type identifier m, and outputs it as 
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the image processing value n. In this embodiment, the 
image processing table access section 252 loads, as n, 
the table value at a position of m x 256 x 256 x 256 + 
R x 256 x 256 + G x 256 + B from the head of the image 
processing table. 

The conversion table changing section 253 loads 
the image processing table from the diagnostic support 
content management section #124, changes the contents 
of the image processing table 251, and changes the 
image processing type identifier of the image 
processing table access section 252. 

FIG. 82 is a flowchart for the image processing 
section 250, which explains how an image processing 
value corresponding to the pixel value of image data is 
15 calculated. 

In step TK-1, the image processing section 250 
acquires pixels one by one from the upper left pixel as 
a start position to the lower right pixel from the 
image data of image information by scanning it to the 
20 right line by line. 

When all the pixels are acquired, the processing 
in the image processing section 250 is terminated. 

In step TK-2, the image processing section 250 
calculates m X 256 X 256 X 256 + R x 256 X 256 + G X 
25 256 + B (to be referred to as an offset value 

hereinafter) from the acquired pixel (R, G, B) and the 
image processing identifier m held by itself, and 
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acquires a table value at the position of the offset 
value from the head of the image processing table 251. 

In step TK-3, the image processing section 250 
holds the table value acquired in step TK-2. 
5 With the above processing, the image processing 

section 250 holds the image processing value corre- 
sponding to a pixel of the image data of the image 
information. The image processing value is used by 
other component in the diagnostic support content 
10 creating section #127. 

(Effect) 

An image processing value can be obtained at high 
speed because it is computed by only addition and 
multiplication without any slow computations such as 

15 division and log computation. 

[10th Embodiment] 

In exchanging image information between terminals, 
when an image file converted into a general format 
(e.g., Windows or bitmap) is used, the contents of the 

20 image can be checked by using a user's favorite image 

viewer. Such a file is therefore often used. 

However, region-of -interest data and accompanying 
data cannot be embedded in an image file in a general 
format . Conventionally, therefore, region-of-interest 

25 data and accompanying data are attached and output as 

other files. This complicates file management. 
Accompanying data contains private information of a 
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patient. That is, if the accompanying data can be 
easily read, a problem arises in terms of privacy. 

The 10th embodiment of the present invention will 
be described with reference to the several views of the 
5 accompanying rendering. FIG. 83 is a block diagram of 

a main program #51 according to the 10th embodiment of 
the present invention. No unnecessary portion is shown 
in this embodiment. The 10th embodiment is the same as 
the second embodiment except that a data embedding 

10 section 260 is added. 

The data embedding section 260 loads image 
information from an image information holding means 151 
through a storage means management section #123, embeds 
accompanying data and region-of-interest data in the 

15 image data, and outputs the resultant data to the 

outside through a diagnostic information input/output 
control means #15. 

In addition, the data embedding section 2 60 
acquires external image data in which accompanying data 

20 and region~of-interest data are embedded, creates image 

information by extracting the accompanying data and 
region-of-interest data from the image data, and holds 
the image information in the image information holding 
means 151 through the storage means management 

25 section #123. 

FIG. 84A is a flowchart for the data embedding 
section 2 60, which explains how accompanying data and 
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region-of -interest data are embedded in image data. 

This operation will be described with reference to 
FIGS. 84A and 85. 

In step TL-1, the data embedding section 2 60 sets 
the data at the first bit of the pixel values of loaded 
image data to 0. For example, at the upper position in 
FIG. 85, the pixel values of the loaded image data are 
arrayed as follows: (R, G, B) = (FF, Al, 00),.... When 
the processing of setting the data at the first bit to 
0 in step TL-1 is applied to one upper left line, the 
pixel values are changed into (R, G, B) = (FE, AO, 
00),..., as indicated at the middle position in 
FIG. 85. 

In step TL-2, the accompanying data and 
region-of-interest data to be embedded are rasterized 
into bit data. If, for example, numerical data of 60 
held as a characteristic value is rasterized into bit 
data, 00111100 is obtained. 

In step TL-3, the data embedding section 260 
embeds the accompanying data and image data, which have 
been rasterized into bit data in step TL-2, in the 
image data. Assume that the embedding position is set 
to the first bit of the pixel values of the image data. 
For example, at the lower position in FIG. 85, the 
characteristic value, 60, which has been rasterized 
into bit data in step TL-2, is embedded in one upper 
left line, and the resultant pixel values of the upper 
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left line become (R, G, B) = (FE, AO, 01),.... 

With the above processing, the accompanying data 
and region-of-interest data are embedded in the image 
data . 

5 FIG. 84B is a flowchart for the data embedding 

section 260, which explains how the accompanying data 
and region-of-interest data embedded in image data are 
acquired in this embodiment. 

This operation will be described with reference to 
10 FIGS. 84B and 86. 

In step TM-1, the data embedding section 260 
acquires the data at the first bit of the pixel values 
of externally obtained image data. For example, 
referring to FIG. 86, the data embedding section 260 
15 acquires the data at the first bit of the pixel data of 

one upper left line to obtain bit data 00111100. 

In step TM-2, the data embedding section 2 60 
acquires the accompanying data or region-of-interest 
data from the acquired bit data, creates image 
20 information, and holds the image information in the 

image information holding means 151 through the storage 
means management section #123. For example, referring 
to FIG. 86, the data embedding section 260 converts 
acquired bit data 00111100 into numerical data of 60, 
25 and creates image information by using this value as 

the value of the characteristic value of the 
accompanying data. 



With the above processing, the accompanying data 
and region-of-interest data are extracted from the 
image data. 

Assume that in this embodiment, the same pixel 
value range, the same correspondence between accom- 
panying data and region-of-interest data, and the same 
correspondence between a pixel value arrangement and 
bit data arrangement are set in the two terminals. 
(Effects) 

The operability in image information exchange 
between terminals is improved by embedding accompanying 
data and region-of-interest data in image data. In 
addition, any leakage of the privacy information of a 
patient as a target image can be prevented. 
[11th Embodiment] 

The 11th embodiment of the present invention is 
characterized in a characteristic value calculation 
technique aimed at objectifying findings in endoscopic 
images. More specifically, this embodiment is 
configured to extract a see-through blood vessel image 
(to be referred to as a blood vessel image hereinafter) 
and calculate a characteristic value associated with 
the blood vessel running state of the image. The 11th 
embodiment will be described with reference to FIGS. 87 
to 98. 

(Arrangement) 

A diagnostic support apparatus in the 11th 
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embodiment has the same arrangement as that in the 
second embodiment, and hence a detailed description 
thereof will be omitted. 

A method of calculating a characteristic value in 
this embodiment will be described below, assuming that 
the method is executed by a blood vessel characteristic 
value calculation means 102. 

FIG. 87 is a view of a main program #121 having 
a characteristic value calculation means 008 according 
to the 11th embodiment. The main program #121 is 
comprised of an image storage means 007 for storing 
image data input from a video processor 004 in an 
endoscopic device 001 through a diagnostic information 
input/output control means #15, the characteristic 
value calculation means 008 for calculating a charac- 
teristic value from the image data stored in the 
storage means, and a diagnostic support information 
display means 009 for displaying diagnostic support 
information on the basis of the characteristic value 
calculated by the characteristic value calculation 
means . 

FIG. 88 is a view showing the arrangement of the 
characteristic value calculation means 008 in the 11th 
embodiment. The characteristic value calculation means 
008 is comprised of a blood vessel extraction means 101 
for extracting a blood vessel image in the image data 
stored in the image storage means 007, and a blood 
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vessel characteristic value calculation means 102 for 
evaluating a blood vessel running state on the basis of 
the output from the blood vessel extraction means 101, 
and calculating a characteristic value. 

FIG. 8 9 is a view showing the arrangement of the 
blood vessel extraction means 101 in the characteristic 
value calculation means 008. The blood vessel 
extraction means 101 is comprised of a preprocessing 
section 111 which performs preprocessing for the image 
data, a blood vessel candidate extracting section 121 
which extracts a blood vessel candidate on the basis of 
an output from the preprocessing section 111, a density 
gradient calculating section 131 which calculates 
density gradient information using the image data on 
the basis of an output from the preprocessing section 
121, a shape edge determining section 132 which 
determines a shape edge on the basis of an output from 
the density gradient calculating section 131, and a 
separating section 141 which separates and removes a 
shape edge from a blood vessel candidate on the basis 
of outputs from the blood vessel candidate extracting 
section 121 and shape edge determining section 132. 
The blood vessel candidate extracting section 121 is 
comprised of an edge information detecting section 122 
and color tone calculating section 123. 

FIG. 90 is a flowchart for mainly explaining 
processing in the blood vessel extraction means 101. 
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FIG. 91 is a block diagram of the preprocessing 
section 111. The preprocessing section 111 is 
comprised of the following blocks: an inverse gamma 
correction processing section 112 which cancels gamma 
correction applied to the image data, a noise 
suppressing section 113 which suppresses noise in the 
image data, and a color misregistration correcting 
section 114 which corrects displacements between color 
signals due to the difference in imaging timing between 
the respective types of color signals when the image 
data is constituted by a plurality of color signals. 

FIG. 92 is a schematic flowchart showing 
processing in the blood vessel candidate extracting 
section 121 which extracts a blood vessel candidate 
on the basis of outputs from the edge information 
detecting section 122 and color tone calculating 
section 123. 

FIG. 93 shows an example of a spatial filter for 
performing second-order differentiation processing in 
the edge information detecting section 122. 

FIG. 94 is a schematic flowchart showing 
processing in the shape edge determining section 132 
based on an output from the density gradient 
calculating section 131. FIG. 95 is a schematic 
flowchart showing the processing of separating and 
removing a shape edge from a blood vessel candidate on 
the basis of the results obtained by the blood vessel 



candidate extracting section 121 and shape edge 
determining section 132. 

FIG. 96 is a conceptual view of a density 
distribution, density gradient, second-order 
differentiation, color tone data, and blood vessel 
candidate data (to be described later) on a horizontal 
line of an image on which a blood vessel and shape edge 
exist . 

FIG. 97 is a conceptual view of the density 
distribution, density gradient, shape edge data based 
on shape edge determination (to be described later) at 
a blood vessel and shape edge. FIG. 98 is a conceptual 
view of the logical product of the blood vessel 
candidate data and shape edge data at a blood vessel 
and shape edge . 
(Operation) 

In this embodiment, the image data input from the 
video processor 004 and recorded on the image storage 
means 007 is constituted by three image data, i.e., R, 
G, and B image data, obtained by a field sequential 
type encoscope. 

The characteristic value calculation means 008 
reads out a predetermined area of the image data (image 
data in a set region of interest) from the image 
storage means 007 (step S101) . The blood vessel 
extraction means 101 shown in FIG. 8 8 then performs 
blood vessel image extraction processing (step S102) . 



As shown in FIG . 89, the blood vessel extraction 
means 101 inputs R, G, and B image data to the 
preprocessing section 111. 

As shown in FIG. 91, in the preprocessing section 
111, the inverse gamma correction processing section 

112 performs inverse gamma correction for each of the 
R, G, and B image data by looking up a predetermined 
correction table, and outputs the result to the noise 
suppressing section 113. The noise suppressing section 

113 performs noise suppression using a median filter 
having a mask size of 3X3. The noise suppression 
result is input to the color misregistration correcting 
section 114. The color misregistration correcting 
section 114 calculates a correlation coefficient 
between the G and R image data when the R image data is 
shifted from the G image data by predetermined numbers 
of pixels in the horizontal and vertical directions, 
and the R image data is shifted by a shift amount 

that provides a maximum value, thus terminating the 
correction processing. The above correction processing 
is executed with respect to the B image data with 
reference to the G image data in the same manner as 
described above. This operation corrects the color 
misregistration between the R, G, and B image data 
which is caused in the field sequential type endoscope. 
The image data whose misregistration with respect to 
the G image data is corrected by the color 
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misregistration correction processing are newly called 
R, G, and B image data, and the image data at the 
respective pixels are represented by R(x, y) , G(x, y) , 
and B(x, y) . Note that x and y represent coordinate 
5 positions in the image data in the horizontal and 

vertical directions (the above operation is done in 
step S103) . 

The R, G, and B image data obtained by the 
preprocessing section 111 are input to the blood vessel 

10 candidate extracting section 121 and density gradient 

calculating section 131. 

As shown in FIG. 89, in the blood vessel candidate 
extracting section 121, the image data obtained by the 
preprocessing section 111 are input to the edge 

15 information detecting section 122 and color tone 

calculating section 123. 

The edge information detecting section 122 
performs second-order differentiation processing for 
the G image data (step S105) . In the above processing, 

20 convolution computation of the G image data is 

performed using a 3 X 3 spatial filter like the one 
shown in FIG. 93. The result obtained by the above 
computation is represented by V 2 G(x, y) . 

The color tone calculating section 123 calculates 

25 color tone data C (x, y) from the R, G, and B image data 

according to mathematical expression $Kl (step S104) . 



R(x, y)/(R(x, y) + G(x, y) + B(x, y) ) 

expression £Kl 

As shown in FIG. 92, the blood vessel candidate 
extracting section 121 stores, in a memory (not shown), 
a pixel PV, of V 2 G(x, y) output from the edge 
information detecting section 122, which has a value 
equal to or larger than a predetermined threshold TV 
(step S220) . With respect to the pixel PV, the blood 
vessel candidate extracting section 121 calculates a 
minimum value Cmin of the color tone data C(x, y) 
output from the color tone calculating section 123 
(step S221) . The blood vessel candidate extracting 
section 121 further executes binarization processing of 
assigning value 1 to each pixel whose color tone data 
C(x, y) is equal to or more than the minimum value Cmin 
and assigning 0 to each pixel whose color tone data is 
less than Cmin (steps S222 and S108) • The obtained 
binarized data is output as blood vessel candidate data 
BiC(x, y) to the separating section 141. As shown in 
FIG. 96, the blood vessel candidate data BiC(x, y) 
contains a shape edge portion together with a blood 
vessel portion, and hence the shape edge portion is 
separated by the separating section 141 (to be 
described later) . 

The density gradient calculating section 131 
calculates the gradient of the R image data from the 
preprocessing section 111 according to mathematical 
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expression $62 (step S106) . 

|R(x+l, y) - R(x, y) I + I R(x, y+1) - R(x, y) | 

expression $62 
where | | indicates an absolute value. 
5 The density gradient calculating section 131 also 

calculates the gradients of the G and B image data in 
the same manner, and outputs the results to the shape 
edge determining section 132. Note that the obtained 
results are respectively represented by Grad R(x, y) , 
10 Grad G(x, y) , and Grad B(x, y) . 

As shown in FIG. 94, the shape edge determining 
section 132 calculates a linear sum Grad C(x, y) of 
Grad R(x, y) , Grad G(x, y) , and Grad B (x, y) output 
from the density gradient calculating section 131 
15 according to equation $63 (steps S230 and S107) . 

Grad C(x, y) 

= a'Grad R(x, y) + j3-GradG(x, y) + 0-GradB(x, y) 

expression $63 
Predetermined values are used as weighting factors 
20 cc , j3 , and 6 , and all are set to 1 in this embodiment. 

The difference in Grad C between a blood vessel 
portion and a shape edge portion will be described. 
Blood vessel images differ in contrast among R, G, and 
B image data depending on differences in depth at which 
25 blood vessels run in the mucous membrane. More 

specifically, a blood vessel at a deep depth is formed 
into R image data by imaging return light of 



irradiation light of R (red) having a long wavelength, 
a blood vessel at a shallow depth is formed into B 
image data, and a blood vessel at an intermediate depth 
is formed into G image data. The density gradient of a 
blood vessel portion is smaller than that of a shape 
edge portion. In contrast to this, at a shape edge, 
the difference in contrast between image data is 
relatively small, and the difference in density 
gradient is relatively large. For this reason, as 
shown in FIG. 97, the linear sum Grad C of the shape 
edge portion is large. 

Threshold processing is performed for the linear 
sum Grad C (x, y) using a predetermined threshold TGrad, 
and binarization is performed such that value 1 is 
assigned to each pixel whose Grad C (x, y) is equal to 
or more than TGrad, and value 0 is assigned to each 
pixel whose Grad C (x, y) is less than TGrad (step 
S231), thereby creating shape edge data BiGrad(x, y) . 
This data is output to the separating section 141. 

As shown in FIG. 95, the separating section 141 
calculates a logical product L(x, y) of the blood 
vessel candidate data BiC(x, y) output from the blood 
vessel candidate extracting section 121 and the shape 
edge data BiGrad(x, y) output from the shape edge 
determining section 132 (step S240) . A portion based 
on the shape edge in the blood vessel candidate data 
is obtained from this result, as indicated by the 
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conceptual view of FIG. 98. Since the logical product 
L does not include all blood vessel candidate data 
based on the shape edge, the separating section 141 
executes expansion processing with respect to the 
logical product L (step S241), and removes expanded 
data Exp as the obtained result from the blood vessel 
candidate data BiC, thereby separating the shape edge 
portion (steps S242 and S109) . That is, if the blood 
vessel candidate data BiC at a pixel (i, j) of the 
logical product L(x, y) or any one of eight pixels 
adjacent to (i, j) is value 1, the value of expanded 
data Exp(i, j) is set to 1; otherwise, value 0 is 
assigned to the expanded data, thereby creating 
expanded data Exp (x, y) , which is subtracted from the 
blood vessel candidate data BiC(x, y) . 

With this operation, blood vessel extraction data 
Bv(x, y) can be created, which is the image data of an 
image vessel image obtained by separating the shape 
edge from the blood vessel candidate data. 

The blood vessel extraction data Bv(x, y) created 
by the blood vessel extraction means 101 is output 
to the blood vessel characteristic value calculation 
means 102. 

The blood vessel characteristic value calculation 
means 102 counts the number of pixels constituting a 
blood vessel image in the blood vessel extraction data 
Bv(x, y) created by the blood vessel extraction means 
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101, and calculates the ratio of the counted number of 
pixels to the number of pixels in the predetermined 
area, thereby calculating a blood vessel area ratio as 
a characteristic value which indicates the proportion 
5 of the blood vessel to the predetermined area (step 

5110) . The blood vessel area ratio is output to the 
diagnostic support information display means 009. 

After the characteristic value is calculated (step 

5111) , the diagnostic support information display means 
10 009 displays the numerical value of the blood vessel 

area ratio calculated by the blood vessel charac- 
teristic value calculation means 102 as a quantitative 
evaluation value associated with the running state of 
the blood vessel image (step S112) . 

15 (Effect) 

According to the above arrangement, since a shape 
edge in the living body can be separated and extracted 
from a blood vessel image, erroneous extraction can be 
suppressed, and quantitation can be realized in 

20 accordance with a blood vessel. 

(Effects of Embodiments) 

According to the first embodiment of the present 
invention, the diagnostic support apparatus can 
selectively use diagnostic support in accordance with 

25 diagnosis purposes and contents, and can use latest 

diagnostic support contents. 

According to the diagnostic support apparatus of 
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the (l-B)th embodiment of the present invention, when a 
diagnostic support content is updated/added in the 
diagnostic support content server, the content is 
distributed to the diagnostic support execution 
5 terminal, thereby always allowing the use of the latest 

diagnostic support content in a diagnosis. 

According to the diagnostic support apparatus of 
the (l-C)th embodiment of the present invention, a 
latest diagnostic support content can always be used by 

10 inquiring the diagnostic support content server whether 

a diagnostic support content is updated or added. 

According to the diagnostic support apparatus of 
the second embodiment of the present invention, many 
medical facilities/organizations can arbitrarily 

15 create diagnostic support contents, various medical 

information, image data, and expert medical knowledge 
accumulated in the respective facilities/organizations 
can be widely used on diagnostic support apparatuses. 
In addition, since, for example, data can be easily 

20 added to a created diagnostic support content, case 

data dispersed in many medical facilities/organizations 
can be effectively used to improve the performance of 
the diagnostic support apparatus. 

According to the third embodiment of the present 

25 invention, displaying statistically processed 

information on a graph facilitates comparison with 
statistically processed information and provides an 
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objective understanding of graph display based on the 
statistically processed information. 

In addition, in creating a graph, classification 
items and data values are separately displayed and 
5 selected. This prevents the operator from mistakenly 

selecting a classification item as a data value or 
mistakenly selecting a data value as a classification 
item, and improves operability. Since a combination of 
a plurality of selected classification items is used as 

10 a classification item, the labor spent to create a 

graph is reduced. Since only items selected from a 
combination of a plurality of selected classification 
items are used as classification items, the labor spent 
to create a graph is reduced. 

15 According to the fourth embodiment of the present 

invention, images, accompanying data, and graph 
elements can be referred to in association with each 
other, resulting in improved operability. 

According to the fifth embodiment of the present 

20 invention, an improvement in operability in graph 

creation and prevention of error setting of image 
information can be realized. In providing information, 
a menu of a list of choices to be input is created and 
displayed in accordance with hierarchical information 

25 and the contents set in higher hierarchical levels. 

This prevents the operator from erroneously inputting 
information to a choice that cannot be selected. In 



addition, since no choice that cannot be selected is 
displayed, the display becomes easy to read, and the 
operability is improved. Furthermore, in accordance 
with the contents set at higher hierarchical levels, 
the names of items to be input are updated/displayed, 
and items to be input are set. This prevents the 
operator to erroneously input information to items that 
cannot be selected. In addition, since unnecessary 
display in the window is omitted, the operability is 
improved. 

According to the sixth embodiment of the present 
invention, a region of interest can be easily set on an 
image . 

According to the seventh embodiment of the present 
invention, accompanying data can be easily recognized 
with respect to image data. 

According to the eighth embodiment of the present 
invention, since the patient examination information 
displayed on an image is erased, a leakage of patient 
privacy information can be prevented. 

According to the ninth embodiment of the present 
invention, an image processing value can be obtained at 
high speed because it is computed by only addition and 
multiplication without any slow computations such as 
division and log computation. 

According to the 10th embodiment of the present 
invention, the operability in image information 



- 142 - 



exchange between terminals is improved by embedding 
accompanying data and region-of-interest data in 
image data. In addition, a leakage of the privacy 
information of a patient as a target image can be 
prevented. 

According to the present invention, various 
information, image data, and expert medical knowledge 
accumulated in many medical facilities can be widely 
used on diagnostic support apparatuses. in addition, 
the performance of the diagnostic support apparatus can 
be improved. Diagnostic support can be selectively 
used in accordance with purposes and contents. 
Furthermore, various processes and operations required 
to create diagnostic support contents can be easily and 
15 effectively assisted. 
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